-- Logs begin at Fri 2022-05-27 08:35:44 UTC, end at Fri 2022-05-27 10:15:05 UTC. -- May 27 09:26:53.059816 dv-cinder-825492-18-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 09:26:53.068293 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 09:26:53 2022] *** May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: nodename: dv-cinder-825492-18-iscsi May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: machine: x86_64 May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: clock source: unix May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: pcre jit disabled May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: detected number of CPU cores: 4 May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: current working directory: / May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: detected binary path: /usr/bin/uwsgi-core May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: your processes number limit is 47680 May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: your memory page size is 4096 bytes May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: detected max file descriptor number: 2048 May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: lock engine: pthread robust mutexes May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: thunder lock: enabled May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 09:26:53.072343 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 09:26:53.117245 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: Python main interpreter initialized at 0x55a33f41c9c0 May 27 09:26:53.117245 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: python threads support enabled May 27 09:26:53.117245 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: your server socket listen backlog is limited to 100 connections May 27 09:26:53.117245 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: your mercy for graceful operations on workers is 90 seconds May 27 09:26:53.117828 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: mapped 403077 bytes (393 KB) for 2 cores May 27 09:26:53.117828 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: *** Operational MODE: preforking *** May 27 09:26:53.118049 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: *** uWSGI is running in multiple interpreter mode *** May 27 09:26:53.118049 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: spawned uWSGI master process (pid: 103860) May 27 09:26:53.118284 dv-cinder-825492-18-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 09:26:53.128041 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: spawned uWSGI worker 1 (pid: 103861, cores: 1) May 27 09:26:53.128041 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: spawned uWSGI worker 2 (pid: 103862, cores: 1) May 27 09:26:53.128041 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 09:26:54.317118 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 09:26:54.471917 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 09:26:55.059536 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:26:55.059536 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: from cryptography.utils import int_from_bytes May 27 09:26:55.060046 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:26:55.060046 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: from cryptography.utils import int_from_bytes May 27 09:26:55.182102 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:26:55.182102 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: from cryptography.utils import int_from_bytes May 27 09:26:55.182469 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:26:55.182469 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: from cryptography.utils import int_from_bytes May 27 09:26:57.693564 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:26:57.694294 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:26:57.694431 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:26:57.694722 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:26:57.694983 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:26:57.695371 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.695699 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.695811 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:26:57.696156 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.696259 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:26:57.696350 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.696602 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:26:57.696791 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.696945 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.697038 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:26:57.697214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:26:57.697309 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.697574 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.697669 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.697903 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.698001 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.698163 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.698322 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.698528 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.698640 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.698853 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-18-iscsi {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.698977 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.699176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.699292 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.699487 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.699604 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.699805 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.699961 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.700126 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.700280 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.700416 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.700557 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.700742 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.700902 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.701044 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.701145 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-18-iscsi {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.701437 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.701528 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.701749 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.701984 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.702083 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.702314 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.702416 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.702627 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.702712 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.703078 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.703233 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.703364 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.703497 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.703625 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.703800 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.703938 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.704116 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.704249 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.704427 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.704545 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.704742 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.704878 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.705168 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.705300 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-18-iscsi {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.705494 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.705640 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.705806 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.705937 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.706121 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.706266 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.706464 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.706612 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.706812 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.706963 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.707120 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.707258 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.707481 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.707574 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-18-iscsi {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.707805 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.707940 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.708113 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.708207 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.708488 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.709111 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.709324 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.709486 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.709645 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.709812 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.709966 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.710129 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.710312 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.710507 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.710627 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.710835 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.710921 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.711147 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.711244 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.711481 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.711631 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.711803 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.711892 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.712060 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.712156 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.712370 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.712472 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.712689 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.712783 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.713008 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.713100 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.713324 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.713425 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.713571 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.713663 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.713819 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.713941 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.714140 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.714375 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.714535 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.714686 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.714828 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.714970 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.715110 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.715244 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.715383 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.715525 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.715667 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.715803 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.715949 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.716090 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.716249 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.716395 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.716531 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.716675 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.716811 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.716979 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.717130 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.717272 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.717417 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.717561 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.717758 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.717903 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.718067 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.718238 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.718387 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.718528 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.718686 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.718894 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.719043 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.719187 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.719331 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.719470 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.719667 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.719814 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.719991 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.720131 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.720320 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.720468 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.720633 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.720789 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.720957 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.721109 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.721266 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.721406 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.721571 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.721719 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.721878 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.722036 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.722177 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.722450 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.722597 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.722748 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.722882 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.723021 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.723154 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.723287 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.723501 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.723646 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.723787 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.723926 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.724082 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.724227 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.724374 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.724600 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.724747 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.724938 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.725089 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.725274 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.725430 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.725567 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.725706 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.725847 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.725989 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.726133 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.726316 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.726452 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.726586 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.726767 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.726916 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.727083 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.727232 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.727395 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.727581 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.727729 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.727999 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.728160 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.728296 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.728460 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.728602 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.728845 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.728987 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.729173 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.729324 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.729486 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.729628 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.729792 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.729937 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.730101 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.730280 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.730435 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.730574 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.730716 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.730850 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.731033 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.731182 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.731358 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.731616 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.731757 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.731963 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.732111 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.732255 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.732401 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.732646 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.732787 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.732920 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.733062 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.733197 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.733338 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.733472 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.733604 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.733782 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.733936 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.734072 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.734244 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.734410 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.734667 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.734808 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.735087 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.735228 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.735399 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.735541 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.735722 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.735876 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.736013 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.736147 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.736324 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.736464 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.736647 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.736797 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.736958 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.737106 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.737263 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.737412 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.737570 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.737720 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.737862 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.738054 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.738233 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.738488 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.738646 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.738814 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.738954 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.739089 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.739229 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.739362 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.739538 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.740217 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.740367 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.740549 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.740690 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.740863 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.741017 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.741170 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.741340 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.741480 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.741729 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.741870 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:26:57.742051 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.742248 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.742482 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.742643 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.742845 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.742984 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.743126 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.743262 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.743429 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.743570 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.743748 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.743897 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.744079 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.744220 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.744397 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.744539 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.744708 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.744859 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.745023 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.745163 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.745338 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.745490 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.745653 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.745802 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.745967 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.746114 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.746307 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.746536 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.746674 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.746821 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.746962 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.747096 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.747230 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.747375 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.747510 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.747651 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.747830 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.747972 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.748152 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.748384 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.748525 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.748667 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.748810 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.748944 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.749084 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.749240 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.749436 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.749578 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.749777 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.749919 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.750103 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.750289 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.750445 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.750581 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.750741 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.750898 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.751055 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.751195 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.751379 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.751522 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.751722 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.751871 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.752038 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.752179 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.752355 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.752495 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.752670 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.752812 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.753032 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.753180 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.753322 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.753475 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.753610 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.753751 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.753891 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.754034 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.754218 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.754374 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.754538 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.754687 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.754854 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.755003 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.755168 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.755319 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.756106 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.756248 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.756382 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.756534 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.756676 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.756811 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.756953 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.757087 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.757255 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.757397 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.757564 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.757704 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.757870 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.758024 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.758171 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.758354 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.758489 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.758622 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.758809 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.758952 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.759137 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.759279 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.759508 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.759662 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.759798 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.759950 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.760100 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.760242 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.760377 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.760517 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.760658 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.760800 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.760993 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.761142 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.761284 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.761420 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.761553 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.761695 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.761865 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.762016 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.762153 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.762322 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.762494 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.762650 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.762793 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.762927 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.763143 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.763285 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.763420 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.763564 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.763699 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.763851 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.763993 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.764127 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.764279 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.764420 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.764588 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.764737 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.764896 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.765037 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.765206 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.765348 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.765513 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.765693 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.765851 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.765988 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.766130 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.766306 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.766444 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.766577 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.766759 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.766901 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.767130 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.767270 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.767437 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.767591 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.767742 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.767885 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.768073 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.768221 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.768391 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.768531 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.768694 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.768850 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.768992 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.769126 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.769292 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.769433 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.769598 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.769758 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.769895 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.770030 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.770210 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.770408 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.770550 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.770698 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.770834 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.770967 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.771162 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.771311 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.771454 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.771598 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.771743 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.771877 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.772067 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.772209 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.772366 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.772503 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.772665 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.772806 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.772969 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.773132 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.773350 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.773497 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.773640 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.773786 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.773921 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.774054 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.774257 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.774402 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.774573 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.774714 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.774897 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.775118 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.775263 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.775406 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.775541 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.775702 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.775873 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.776028 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.776185 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.776333 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.776498 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.776639 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.776812 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.776962 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.777127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.777274 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.777440 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.777581 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.777738 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.777881 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.778101 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.778265 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.778415 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.778550 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.778690 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.778833 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.778992 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.779133 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.779310 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.779449 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.779614 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.779777 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.779913 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.780054 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.780249 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.780389 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.780560 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.780702 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.780878 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.781019 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.781198 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.781337 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.781511 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.781660 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.781827 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.781969 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.782136 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.782336 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.782490 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.782639 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.782781 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.782921 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.783067 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.783218 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.783376 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.783584 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.783730 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.783881 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.784021 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.784170 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.784311 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.784451 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.784590 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.784729 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.784868 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.785016 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.785165 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.785307 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.785469 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.785635 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.785784 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.785934 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.786097 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.786305 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.786447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.786586 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.786759 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.786918 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.787061 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.787200 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.787385 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.787533 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.787693 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.787834 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.787996 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.788143 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.788292 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.788435 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.788588 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.788737 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.788884 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.789026 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.789166 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.789319 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.789470 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.789628 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.789769 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.789909 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.790056 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.790242 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.790402 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.790546 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.790685 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.790832 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.790974 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.791122 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.791263 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.791411 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.791571 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.791712 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.791852 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.791999 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.792165 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.792313 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.792460 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.792601 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.792784 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.792938 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.793105 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.793251 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.793412 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.793587 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.793804 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.793962 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.794111 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.794281 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.794436 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.794601 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.794765 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.794909 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.795049 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.795189 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.795336 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.795488 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.795637 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.795778 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.795919 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.796059 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.796205 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.796346 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.796494 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.796634 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.796781 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.796928 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.797069 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.797208 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.797377 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.797524 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.797664 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.797813 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.797961 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.798110 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.798300 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.798448 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.798595 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.798735 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.798876 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.799025 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.799168 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.799318 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.799457 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.799604 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.799757 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.799907 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.800048 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.800199 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.800363 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.800511 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.800672 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.800828 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.800971 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.801110 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.801268 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.801409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.801557 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.801698 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.801864 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.802020 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.802727 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.802879 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.803107 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.803311 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.803459 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.803647 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.803828 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.804038 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.804268 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.804411 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.804582 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.804739 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.804902 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.805050 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.805203 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.805344 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.805548 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.805702 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.805903 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.806070 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.806397 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.806562 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.806705 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.806845 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.806984 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.807122 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.807275 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.807424 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.807578 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.807729 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.807869 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.808016 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.808182 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.808417 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.808571 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.808712 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.808853 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.809007 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.809148 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.809296 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.809438 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.809577 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.809717 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.809863 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.810014 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.810162 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.810317 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.810431 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.810522 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.810604 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.810685 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.810776 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.810973 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.811091 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.811299 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.811388 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.811861 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.811969 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.812166 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.812256 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.812470 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.812565 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.812775 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.812867 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.813116 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.813204 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.813421 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.813508 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.813725 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.813812 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.814071 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.814159 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.814403 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.814492 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.814732 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.814819 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.815036 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.815130 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.815360 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.815447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.815668 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.815756 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.815997 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.816097 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.816300 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.816433 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.816609 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.816745 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.816918 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.817053 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.817221 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.817360 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.817531 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.817673 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.818465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.818641 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.818842 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.819008 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.819151 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.819291 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.819438 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.819579 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.819726 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.819877 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.820018 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.820158 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.820303 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.820444 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.820608 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.820749 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.820890 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.821029 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.821168 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.821307 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.821455 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.821596 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.821772 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.821928 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.822076 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.822242 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.822404 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.822556 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.822696 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.822836 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.822987 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.823127 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.823281 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.823422 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.823562 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.823701 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.823847 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.823997 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.824163 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.824381 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.824540 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.824687 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.824828 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.824980 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.825123 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.825270 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.825411 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.825557 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.825699 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.825851 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.825999 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.826140 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.826340 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.826483 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.826623 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.826776 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.826918 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.827058 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.827198 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.827345 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.827499 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.827640 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.827780 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.827926 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.828067 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.828218 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.828433 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.828576 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.828717 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.828856 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.829009 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.829150 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.829299 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.829440 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.829588 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.829728 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.829875 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.830058 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.830247 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.830398 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.830539 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.830679 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.830819 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.830969 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.831110 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.831250 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.831390 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.831530 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.831670 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.831817 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.831959 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.832109 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.832249 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.832390 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.832529 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.832677 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.832819 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.832975 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.833124 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.833268 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.833427 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.833582 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.833725 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.833872 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.834025 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.834166 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.834361 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.834574 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.834727 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.834870 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.835010 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.835149 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.835297 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.835438 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.835579 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.835725 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.835883 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.836025 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.836173 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.836343 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.836493 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.836642 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.836791 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.836958 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.837119 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.837262 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.837402 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.837576 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.837731 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.837892 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.838041 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.838183 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.838386 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.838529 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.838670 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.838819 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.838968 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.839131 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.839279 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.839457 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.839605 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.839789 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.839949 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.840119 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.840268 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.840409 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.840548 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.840722 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.840878 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.841020 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.841159 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.841329 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.841475 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.841624 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.841764 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.841937 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.842085 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.842270 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.842431 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.842581 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.842721 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.842862 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.843008 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.843153 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.843300 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.843441 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.843580 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.843767 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.843926 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.844067 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.844220 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.844362 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.844502 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.844723 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.844871 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.845019 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.845170 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.845312 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.845452 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.845598 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.845754 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.845926 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.846084 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.846255 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.846413 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.846562 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.846702 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.846850 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.846991 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.847188 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.847334 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.847501 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.847648 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.847815 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.847965 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.848106 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.848245 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.848402 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.848597 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.848756 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.848896 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.849103 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.849252 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.849421 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.849582 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.849724 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.849884 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.850152 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.850321 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.850487 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.850646 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.850787 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.850927 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.851112 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.851268 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.851409 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.851557 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.851699 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.851849 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.851998 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.852145 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.852311 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.852469 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.852618 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.852759 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.852920 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.853066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.853214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.853365 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.853541 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.853697 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.853848 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.854003 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.854153 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.854347 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.854597 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.854760 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.854968 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.855114 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.855265 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.855407 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.855583 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.855729 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.855908 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.856080 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.856235 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.856376 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.856525 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.856665 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.856812 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.857042 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.857195 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.857337 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.857485 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.857627 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.857768 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.857907 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.858058 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.858245 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.858402 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.858544 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.858693 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.858842 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.858980 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.859088 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.859299 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.859402 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.859621 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.859722 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.860019 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.860119 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.860349 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.860440 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.860661 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.860756 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.860986 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.861089 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.861313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.861400 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.861621 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.861709 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.861933 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.862030 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.862260 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.862395 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.862572 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.862690 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.862876 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.863004 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.863202 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.863318 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.863510 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.863635 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.863825 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.863947 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.864138 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.864257 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.864454 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.864587 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.865309 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.865562 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.865652 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.865888 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.865976 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.866221 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.866311 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.866541 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.866629 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.866853 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.866940 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.867163 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.867252 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.867491 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.867580 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.867801 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.867890 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.868125 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.868213 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.868435 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.868522 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.868737 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.868829 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.869045 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.869138 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.869354 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.869519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.869699 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.869865 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.870019 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.870162 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.870395 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.870584 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.870731 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.870899 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.871043 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.871185 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.871325 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.871465 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.871605 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.871758 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.871900 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.872040 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.872206 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.872354 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.872525 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.872682 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.872855 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.873003 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.873151 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.873294 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.873443 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.873592 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.873732 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.873872 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.874041 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.874189 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.874379 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.874529 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.874681 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.874822 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.874969 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.875110 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.875309 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.875525 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.875678 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.875820 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.875961 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.876109 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.876257 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.876399 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.876572 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.876729 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.876870 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.877018 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.877159 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.877298 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.877446 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.877589 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.877729 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.877881 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.878023 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.878264 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.878423 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.878568 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.878719 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.878868 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.879010 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.879177 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.879318 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.879469 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.879624 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.879765 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.879915 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.880063 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.880205 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.880915 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.881079 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.881233 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.881381 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.881521 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.881661 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.881801 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.881950 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.882091 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.882292 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.882442 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.882593 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.882735 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.882913 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.883076 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.883217 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.883357 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.883527 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.883675 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.883846 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.883994 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.884162 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.884309 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.884482 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.884638 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.884857 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.885054 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.885212 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.885389 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.885562 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.885782 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.885937 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.886079 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.886265 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.886424 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.886643 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.886801 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.886944 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.887091 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.887259 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.887425 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.887580 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.887722 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.887863 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.888017 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.888161 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.888302 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.888488 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.888637 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.888802 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.888948 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.889118 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.889278 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.889432 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.889576 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.889716 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.889857 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.890064 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.890276 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.890426 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.890578 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.890720 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.890867 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.891055 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.891230 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.891374 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.891513 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.891661 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.891802 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.891955 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.892097 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.892272 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.892420 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.892586 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.892734 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.892896 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.893039 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.893191 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.893333 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.893480 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.893633 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.893783 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.893932 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.894080 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.894249 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.894399 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.894550 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.894708 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.894861 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.895002 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.895142 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.895328 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.895485 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.895900 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.896180 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.896180 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.896460 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.896601 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.896752 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.896903 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.897057 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.897198 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.897338 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.897555 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.897700 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.897841 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.897982 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.898129 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.898331 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.898486 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.898629 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.898770 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.898909 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.899060 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.899201 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.899349 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.899493 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.899633 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.899782 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.899955 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.900111 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.900263 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.900405 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.900546 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.900696 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.900849 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.901003 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.901146 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.901286 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.901458 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.901608 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.901755 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.901909 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.902052 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.902217 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.902378 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.902527 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.902677 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.902837 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.903019 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.903213 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.903363 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.903592 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.903797 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.903949 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.904176 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.904330 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.904472 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.904613 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.904860 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.905030 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.905184 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.905325 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.905472 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.905614 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.905763 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.905928 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.906152 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.906326 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.906469 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.906620 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.906775 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.906918 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.907069 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.907210 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.907350 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.907498 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.907639 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.907786 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.907936 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.908077 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.908241 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.908468 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.908622 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.908764 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.908904 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.909059 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.909199 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.909356 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.909506 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.909647 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.909787 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.909969 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.910122 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.910312 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.910458 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.910599 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.910747 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.910887 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.911057 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.911200 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.911348 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.911489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.911656 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.911796 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.911945 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.912087 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.912227 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.912367 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.912507 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.912646 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.912794 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.912946 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.913095 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.913237 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.913383 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.913529 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.913682 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.913830 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.913972 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.914112 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.914276 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.914432 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.914586 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.914735 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.914894 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.915035 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.915174 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.915323 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.915465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.915612 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.915761 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.915902 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.916044 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.916274 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.916425 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.916565 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.916716 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.916857 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.916997 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.917149 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.917405 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.917560 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.917710 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.917851 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.918026 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.918183 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.918408 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.918568 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.918731 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.918890 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.919082 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.919272 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.919422 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.919611 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.919769 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.919937 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.920099 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.920279 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.920436 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.920586 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.920738 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.920881 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.921041 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.921184 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.921334 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.921515 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.921664 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.921813 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.921955 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.922125 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.922330 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.922474 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.922625 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.922776 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.922929 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.923070 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.923210 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.923350 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.923496 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.923647 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.923788 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.923929 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.924069 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.924246 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.924403 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.924588 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.924750 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.924899 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.925040 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.925206 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.925363 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.925513 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.925653 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.925827 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.925976 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.926124 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.926379 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.926526 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.926667 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.926820 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.926960 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.927100 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.927781 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.927925 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.928065 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.928205 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.928347 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.928518 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.928666 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.928814 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.928956 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.929215 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.929362 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.929532 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.929680 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.929848 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.929995 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.930248 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.930402 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.930564 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.930705 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.930845 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.930986 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.931157 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.931325 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.931474 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.931625 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.931766 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.931906 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.932080 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.932235 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.932411 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.932569 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.932756 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.932905 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.933088 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.933263 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.933407 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.933548 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.933710 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.933864 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.934019 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.934161 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.934372 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.934488 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.934699 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.934792 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.935025 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.935117 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.935335 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.935425 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.935641 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.935739 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.935947 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.936045 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.936259 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.936382 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.936816 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.936932 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.937139 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.937227 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.937428 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.937517 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.937734 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.937828 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.938043 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.938131 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.938370 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.938459 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.938676 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.938776 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.938980 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.939068 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.939285 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.939371 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.939589 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.939687 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.939894 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.939983 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.940206 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.940304 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.940506 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.940593 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.940810 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.940905 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.941112 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.941199 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.941416 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.941506 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.941719 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.941804 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.942028 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.942122 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.942361 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.942452 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.942671 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.942788 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.943518 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.943622 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.943825 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.943922 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.944131 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.944220 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.944470 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.944567 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.944794 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.944880 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.945114 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.945200 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.945428 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.945522 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.945738 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.945826 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.946060 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.946145 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.946397 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.946503 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.946715 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.946804 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.947030 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.947127 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.947341 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.947437 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.947670 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.947759 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.947981 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.948069 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.948313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.948402 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.948653 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.948756 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.948949 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.949040 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.949260 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.949355 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.949572 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.949660 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.949885 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.949975 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.950219 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.950338 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.950538 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.950693 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.950845 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.950998 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.951149 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.951289 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.951464 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.951618 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.951771 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.951920 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.952064 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.952213 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.952361 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.952502 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.952676 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.952832 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.952977 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.953124 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.953304 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.953452 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.953629 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.953788 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.953937 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.954079 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.954281 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.954432 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.954610 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.954759 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.954907 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.955047 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.955243 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.955391 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.955574 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.955731 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.955884 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.956025 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.956204 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.956351 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.956570 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.956712 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.956860 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.957030 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.957174 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103861) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:26:57.957329 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.957499 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.957848 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.958151 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.958618 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.958868 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:26:57.959115 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103862) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:26:58.017839 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO dbcounter [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Registered counter for database nova_api May 27 09:26:58.019401 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO dbcounter [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Registered counter for database nova_api May 27 09:26:58.038963 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_db.sqlalchemy.engines [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:26:58.042624 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG oslo_db.sqlalchemy.engines [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:26:58.045756 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writer thread running {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:26:58.049109 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writer thread running {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:26:58.103945 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.context [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35(cell1) {{(pid=103861) load_cells /opt/stack/nova/nova/context.py:464}} May 27 09:26:58.107367 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.context [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35(cell1) {{(pid=103862) load_cells /opt/stack/nova/nova/context.py:464}} May 27 09:26:58.107978 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:26:58.109547 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:26:58.110376 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:26:58.111504 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG oslo_concurrency.lockutils [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:26:58.112367 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:26:58.113112 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG oslo_concurrency.lockutils [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:26:58.113916 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG oslo_concurrency.lockutils [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:26:58.114362 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO dbcounter [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Registered counter for database nova_cell0 May 27 09:26:58.116492 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG oslo_concurrency.lockutils [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103862) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:26:58.118529 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO dbcounter [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Registered counter for database nova_cell0 May 27 09:26:58.119060 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO dbcounter [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Registered counter for database nova_cell1 May 27 09:26:58.122471 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO dbcounter [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Registered counter for database nova_cell1 May 27 09:26:58.126134 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_db.sqlalchemy.engines [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:26:58.128400 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_db.sqlalchemy.engines [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:26:58.130465 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG oslo_db.sqlalchemy.engines [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:26:58.131779 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG oslo_db.sqlalchemy.engines [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:26:58.133556 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writer thread running {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:26:58.136114 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writer thread running {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:26:58.138273 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writer thread running {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:26:58.140338 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writer thread running {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:26:58.282847 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO dbcounter [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Registered counter for database nova_cell0 May 27 09:26:58.287762 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO dbcounter [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Registered counter for database nova_cell0 May 27 09:26:58.292365 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_db.sqlalchemy.engines [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103861) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:26:58.296792 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writer thread running {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:26:58.297268 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG oslo_db.sqlalchemy.engines [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103862) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:26:58.303537 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writer thread running {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:26:58.708905 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: WARNING keystonemiddleware.auth_token [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:26:58.716305 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: WARNING keystonemiddleware.auth_token [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:26:58.748353 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: WARNING keystonemiddleware.auth_token [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:26:58.756755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: WARNING keystonemiddleware.auth_token [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:26:59.058289 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: WARNING keystonemiddleware.auth_token [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:26:59.064550 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: WARNING keystonemiddleware.auth_token [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:26:59.070431 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a33f41c9c0 pid: 103861 (default app) May 27 09:26:59.072548 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:26:59.073753 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001800 May 27 09:26:59.074171 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Fri May 27 09:26:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:26:59.104124 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: WARNING keystonemiddleware.auth_token [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:26:59.110180 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: WARNING keystonemiddleware.auth_token [None req-cc498d74-da05-4be4-8a63-2b416c96572f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:26:59.115637 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a33f41c9c0 pid: 103862 (default app) May 27 09:28:23.996809 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:23.997825 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 27 09:28:23.998322 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:28:24.011622 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_api:SELECT=3 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:24.012649 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_cell0:SELECT=3 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:24.013732 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_cell1:SELECT=3 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:24.014549 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:24.601040 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-e9def631-1bc0-4814-b519-67b5feaafd7e admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:24.634713 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-e9def631-1bc0-4814-b519-67b5feaafd7e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.628680 May 27 09:28:24.635631 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Fri May 27 09:28:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:28:27.333856 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:27.335041 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-27fbbaa9-6434-4794-b1b1-a4537647f593 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 May 27 09:28:27.337144 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:28:27.399886 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-b941bbac-b66e-4841-81af-c76ff40175fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "c1"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:27.418488 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:28:27.418488 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: warnings.warn(msg) May 27 09:28:27.555314 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-b941bbac-b66e-4841-81af-c76ff40175fe admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.212695 May 27 09:28:27.556281 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Fri May 27 09:28:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 09:28:27.979636 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-fb45a24c-9124-4d39-9fd7-d8b606228674 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:27.983502 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:28:27.983502 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: warnings.warn(msg) May 27 09:28:28.015067 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_api:SELECT=3 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:28.016360 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_cell0:SELECT=3 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:28.017753 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_cell1:SELECT=3 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:28.018872 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:28.124953 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-fb45a24c-9124-4d39-9fd7-d8b606228674 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.553381 May 27 09:28:28.138226 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Fri May 27 09:28:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:28:30.463852 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-b941bbac-b66e-4841-81af-c76ff40175fe admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:30.465012 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-b941bbac-b66e-4841-81af-c76ff40175fe admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 May 27 09:28:30.465529 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:28:30.579746 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-94406a86-43b8-47c9-9820-c1a5dca45189 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "d1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "name": "ds512M", "disk": 5}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:30.598556 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:28:30.598556 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: warnings.warn(msg) May 27 09:28:30.722175 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-94406a86-43b8-47c9-9820-c1a5dca45189 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.249611 May 27 09:28:30.723291 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Fri May 27 09:28:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:28:30.736260 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-972fffee-8c52-44ca-9ffd-99741e62a1a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:30.741933 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:28:30.741933 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: warnings.warn(msg) May 27 09:28:30.822828 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-972fffee-8c52-44ca-9ffd-99741e62a1a9 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090682 May 27 09:28:30.823848 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Fri May 27 09:28:30 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:28:33.892236 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-94406a86-43b8-47c9-9820-c1a5dca45189 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:33.893840 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-94406a86-43b8-47c9-9820-c1a5dca45189 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002308 May 27 09:28:33.895269 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:28:33.998438 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-6db8c3f2-2021-4e94-9110-f28603cb2d77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "id": "d2"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:34.104568 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-6db8c3f2-2021-4e94-9110-f28603cb2d77 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.199258 May 27 09:28:34.105419 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Fri May 27 09:28:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:28:34.123879 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-af6d7a60-bd64-4cb8-ae6a-a3cb9442e0cb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:34.214165 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-af6d7a60-bd64-4cb8-ae6a-a3cb9442e0cb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097690 May 27 09:28:34.215581 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Fri May 27 09:28:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:28:36.773125 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-6db8c3f2-2021-4e94-9110-f28603cb2d77 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:36.774142 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-6db8c3f2-2021-4e94-9110-f28603cb2d77 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 27 09:28:36.774602 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:28:36.837049 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-306ee293-62bf-4c53-85be-7f6eda473510 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "disk": 10}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:36.914240 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-306ee293-62bf-4c53-85be-7f6eda473510 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133148 May 27 09:28:36.915053 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Fri May 27 09:28:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 09:28:36.929021 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-91203f01-a600-4ec2-8319-a33793916dfa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:37.024529 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-91203f01-a600-4ec2-8319-a33793916dfa admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100636 May 27 09:28:37.025181 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Fri May 27 09:28:36 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:28:39.402805 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-306ee293-62bf-4c53-85be-7f6eda473510 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:39.404500 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-306ee293-62bf-4c53-85be-7f6eda473510 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002237 May 27 09:28:39.405940 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:28:39.493944 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-c4d46ace-87ab-4614-bb61-d20064e1d4a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "disk": 20, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:39.677839 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-c4d46ace-87ab-4614-bb61-d20064e1d4a4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.264545 May 27 09:28:39.678972 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Fri May 27 09:28:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:28:39.698585 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-f27419b9-3b0f-4c28-bcdd-46a532e95f68 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:39.803453 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-f27419b9-3b0f-4c28-bcdd-46a532e95f68 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112039 May 27 09:28:39.814155 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Fri May 27 09:28:39 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:28:42.587525 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-c4d46ace-87ab-4614-bb61-d20064e1d4a4 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:42.588548 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-c4d46ace-87ab-4614-bb61-d20064e1d4a4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 27 09:28:42.588952 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:28:42.658254 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-55a0a364-eec2-4948-85d2-48806271b6ab admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:42.684292 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-55a0a364-eec2-4948-85d2-48806271b6ab admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088682 May 27 09:28:42.684946 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Fri May 27 09:28:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:28:45.278160 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-c4d46ace-87ab-4614-bb61-d20064e1d4a4 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:45.279292 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-c4d46ace-87ab-4614-bb61-d20064e1d4a4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 May 27 09:28:45.281501 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:28:45.361121 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-fea68ffa-093a-40bf-bc83-1d2a98dbd261 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "ram": 512, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:45.452782 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-fea68ffa-093a-40bf-bc83-1d2a98dbd261 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.166094 May 27 09:28:45.453870 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Fri May 27 09:28:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 09:28:45.468624 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-f77de4e1-5368-4565-b11e-767547c042eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:45.561895 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-f77de4e1-5368-4565-b11e-767547c042eb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097929 May 27 09:28:45.562863 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Fri May 27 09:28:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:28:48.459186 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-fea68ffa-093a-40bf-bc83-1d2a98dbd261 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:48.460281 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-fea68ffa-093a-40bf-bc83-1d2a98dbd261 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 May 27 09:28:48.460690 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:28:48.526830 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-10bffe06-0f73-4004-ba22-b8273c9ac637 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 2048, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:48.610426 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-10bffe06-0f73-4004-ba22-b8273c9ac637 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.142930 May 27 09:28:48.611490 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Fri May 27 09:28:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:28:48.630608 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-b4199146-928c-4bc7-b96d-5aed774045b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:48.750866 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-b4199146-928c-4bc7-b96d-5aed774045b2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.125697 May 27 09:28:48.752965 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Fri May 27 09:28:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:28:51.302398 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-10bffe06-0f73-4004-ba22-b8273c9ac637 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:51.303653 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-10bffe06-0f73-4004-ba22-b8273c9ac637 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001709 May 27 09:28:51.304142 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:28:51.370157 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-6c502f8d-1f8a-4c22-b779-1c3c4e11e197 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "3", "name": "m1.medium", "vcpus": 2, "ram": 4096}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:51.444237 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-6c502f8d-1f8a-4c22-b779-1c3c4e11e197 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.133415 May 27 09:28:51.445144 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Fri May 27 09:28:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:28:51.459866 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-8a892ccb-de64-478b-ae9d-83a3ac0307eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:51.550614 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-8a892ccb-de64-478b-ae9d-83a3ac0307eb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094691 May 27 09:28:51.551214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Fri May 27 09:28:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:28:53.965516 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-6c502f8d-1f8a-4c22-b779-1c3c4e11e197 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:53.966992 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-6c502f8d-1f8a-4c22-b779-1c3c4e11e197 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001866 May 27 09:28:53.967624 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:28:54.046257 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-447d9677-62c4-4b92-b832-9ffcf41d7464 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:54.130845 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-447d9677-62c4-4b92-b832-9ffcf41d7464 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.153976 May 27 09:28:54.131371 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Fri May 27 09:28:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:28:54.143689 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-040e39f3-3392-4c91-911e-9bb1ac68e216 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:54.289478 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-040e39f3-3392-4c91-911e-9bb1ac68e216 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.149734 May 27 09:28:54.290114 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Fri May 27 09:28:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:28:57.204788 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-447d9677-62c4-4b92-b832-9ffcf41d7464 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:28:57.205930 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-447d9677-62c4-4b92-b832-9ffcf41d7464 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 27 09:28:57.206369 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:28:57.285936 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-fd721b61-b21c-471d-a58a-214707c9009a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384, "vcpus": 8, "disk": 160, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:57.427513 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-fd721b61-b21c-471d-a58a-214707c9009a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.213606 May 27 09:28:57.428569 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Fri May 27 09:28:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:28:57.442052 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-ead32010-07fc-440a-bd3c-6d4257f158a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:28:57.446236 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:28:57.559554 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-ead32010-07fc-440a-bd3c-6d4257f158a5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.122094 May 27 09:28:57.560237 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Fri May 27 09:28:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:29:22.134365 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-fd721b61-b21c-471d-a58a-214707c9009a admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:22.135547 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-fd721b61-b21c-471d-a58a-214707c9009a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 May 27 09:29:22.135891 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:29:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:29:22.198787 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5b12156c-3f84-485c-ae69-f5b705692fea admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:22.216050 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-5b12156c-3f84-485c-ae69-f5b705692fea admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073557 May 27 09:29:22.216589 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Fri May 27 09:29:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:29:23.220665 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-fd721b61-b21c-471d-a58a-214707c9009a admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:23.222269 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-fd721b61-b21c-471d-a58a-214707c9009a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 27 09:29:23.222731 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:29:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:29:23.420406 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-2a865a20-a892-4138-993a-ac487c90535d admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:23.426685 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.wsgi [None req-2a865a20-a892-4138-993a-ac487c90535d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-2a865a20-a892-4138-993a-ac487c90535d admin admin] Request method failure captured: May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Accept: application/json May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Accept-Encoding: gzip, deflate May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Connection: keep-alive May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Content-Length: 0 May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Host: 10.222.0.48 May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Openstack-Api-Version: compute 2.90 May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Openstack-System-Scope: None May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: User-Agent: python-novaclient May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Auth-Token: gAAAAABikJnz3ak3YKzoh9A1F6dt7QZwYev3scFKbwSnJFmuzigheDi6P5iEz6WgaUtJFi3Eh5QBicD8O3BA9Zn7p1hTWfJrf8HVUWNwWJY04ubxE1VQv6kfvb58dWsiOSTyxOIrv4KUrvnkdhD4mTxqVa69WI4OpS1DMJAkr42lWK0jaeV5fmg May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Domain-Id: None May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Domain-Name: None May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Identity-Status: Confirmed May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Is-Admin-Project: True May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Domain-Id: default May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Domain-Name: Default May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Name: admin May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Role: admin,reader,member May 27 09:29:23.430489 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Roles: admin,reader,member May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_822861f091c54d5980ee4872d75a26fa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Tenant: admin May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Tenant-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Tenant-Name: admin May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User: admin May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Domain-Id: default May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Domain-Name: Default May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Id: c1f81d15d7c54a30853ee3ff06b25bdd May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Name: admin May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: method: > May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: exception: Flavor 42 could not be found. May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: action_args: {'id': '42'} May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:29:23.432214 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:23.433229 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:23.434519 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-2a865a20-a892-4138-993a-ac487c90535d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:29:23.435900 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-2a865a20-a892-4138-993a-ac487c90535d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062586 May 27 09:29:23.435900 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Fri May 27 09:29:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:29:23.442698 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-1b031938-e994-4db0-80e4-8db40aeea395 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:23.445605 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:29:23.464478 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-1b031938-e994-4db0-80e4-8db40aeea395 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025903 May 27 09:29:23.465055 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Fri May 27 09:29:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:29:23.475127 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-19347253-1e59-4137-84a9-8eb5147f0177 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:23.497186 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-19347253-1e59-4137-84a9-8eb5147f0177 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025796 May 27 09:29:23.497743 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Fri May 27 09:29:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:29:23.507867 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-95ba4b23-b718-407c-9b40-4ca30a058893 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:23.513839 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.wsgi [None req-95ba4b23-b718-407c-9b40-4ca30a058893 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-95ba4b23-b718-407c-9b40-4ca30a058893 admin admin] Request method failure captured: May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Accept: application/json May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Accept-Encoding: gzip, deflate May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Connection: keep-alive May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Content-Length: 0 May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Host: 10.222.0.48 May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Openstack-Api-Version: compute 2.90 May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Openstack-System-Scope: None May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: User-Agent: python-novaclient May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Auth-Token: gAAAAABikJnz3ak3YKzoh9A1F6dt7QZwYev3scFKbwSnJFmuzigheDi6P5iEz6WgaUtJFi3Eh5QBicD8O3BA9Zn7p1hTWfJrf8HVUWNwWJY04ubxE1VQv6kfvb58dWsiOSTyxOIrv4KUrvnkdhD4mTxqVa69WI4OpS1DMJAkr42lWK0jaeV5fmg May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Domain-Id: None May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Domain-Name: None May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Identity-Status: Confirmed May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Is-Admin-Project: True May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Domain-Id: default May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Domain-Name: Default May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Name: admin May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Role: admin,reader,member May 27 09:29:23.517086 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Roles: admin,reader,member May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_822861f091c54d5980ee4872d75a26fa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Tenant: admin May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Tenant-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Tenant-Name: admin May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User: admin May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Domain-Id: default May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Domain-Name: Default May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Id: c1f81d15d7c54a30853ee3ff06b25bdd May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Name: admin May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: method: > May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: exception: Flavor 42 could not be found. May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: action_args: {'id': '42'} May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:29:23.523066 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:23.524176 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:23.525465 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-95ba4b23-b718-407c-9b40-4ca30a058893 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:29:23.526743 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-95ba4b23-b718-407c-9b40-4ca30a058893 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014307 May 27 09:29:23.526743 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Fri May 27 09:29:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:29:24.398159 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-19347253-1e59-4137-84a9-8eb5147f0177 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:24.399204 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-19347253-1e59-4137-84a9-8eb5147f0177 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 27 09:29:24.399596 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:29:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:29:24.594805 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-f51ebb70-902c-4560-bbf3-692ed8d9003c admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:24.600834 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.wsgi [None req-f51ebb70-902c-4560-bbf3-692ed8d9003c admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-f51ebb70-902c-4560-bbf3-692ed8d9003c admin admin] Request method failure captured: May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Accept: application/json May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Accept-Encoding: gzip, deflate May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Connection: keep-alive May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Content-Length: 0 May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Host: 10.222.0.48 May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Openstack-Api-Version: compute 2.90 May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Openstack-System-Scope: None May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: User-Agent: python-novaclient May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Auth-Token: gAAAAABikJn0cOmq2luMahqV4cHC8sidMyw4-Z-FoAglBtYnnfILheio_H1tlRTGOj9WjTPdaMMrdcgMiPrYegggifFpyAJK1C2P76pBhuQ3G7Ucxvzqyn9oYKA6U_9XUfRZ-WXJWtn7VrvtG0qm3LdzEltuAXuSUIWhkqfj1KpoadEOOKkrQVk May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Domain-Id: None May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Domain-Name: None May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Identity-Status: Confirmed May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Is-Admin-Project: True May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Domain-Id: default May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Domain-Name: Default May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Name: admin May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Role: admin,reader,member May 27 09:29:24.602375 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Roles: admin,reader,member May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_822861f091c54d5980ee4872d75a26fa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Tenant: admin May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Tenant-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Tenant-Name: admin May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User: admin May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Domain-Id: default May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Domain-Name: Default May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Id: c1f81d15d7c54a30853ee3ff06b25bdd May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Name: admin May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: method: > May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: exception: Flavor 84 could not be found. May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: action_args: {'id': '84'} May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:29:24.604028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:24.604898 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:24.606026 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-f51ebb70-902c-4560-bbf3-692ed8d9003c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:29:24.607196 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-f51ebb70-902c-4560-bbf3-692ed8d9003c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065177 May 27 09:29:24.607196 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Fri May 27 09:29:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:29:24.613626 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-a03e6489-be10-4fa5-a359-4e9bf67f4aec admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:24.629481 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-a03e6489-be10-4fa5-a359-4e9bf67f4aec admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019490 May 27 09:29:24.630286 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Fri May 27 09:29:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:29:24.640227 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-564def8e-70c3-4e32-95ed-8c8956df21ed admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:24.654773 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-564def8e-70c3-4e32-95ed-8c8956df21ed admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018486 May 27 09:29:24.655301 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Fri May 27 09:29:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:29:24.664448 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-75457513-3beb-4fea-b330-878d4f550cd2 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:24.669881 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.wsgi [None req-75457513-3beb-4fea-b330-878d4f550cd2 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-75457513-3beb-4fea-b330-878d4f550cd2 admin admin] Request method failure captured: May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Accept: application/json May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Accept-Encoding: gzip, deflate May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Connection: keep-alive May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Content-Length: 0 May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Host: 10.222.0.48 May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Openstack-Api-Version: compute 2.90 May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Openstack-System-Scope: None May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: User-Agent: python-novaclient May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Auth-Token: gAAAAABikJn0cOmq2luMahqV4cHC8sidMyw4-Z-FoAglBtYnnfILheio_H1tlRTGOj9WjTPdaMMrdcgMiPrYegggifFpyAJK1C2P76pBhuQ3G7Ucxvzqyn9oYKA6U_9XUfRZ-WXJWtn7VrvtG0qm3LdzEltuAXuSUIWhkqfj1KpoadEOOKkrQVk May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Domain-Id: None May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Domain-Name: None May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Identity-Status: Confirmed May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Is-Admin-Project: True May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Domain-Id: default May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Domain-Name: Default May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Name: admin May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Role: admin,reader,member May 27 09:29:24.671409 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Roles: admin,reader,member May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_822861f091c54d5980ee4872d75a26fa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Tenant: admin May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Tenant-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Tenant-Name: admin May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User: admin May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Domain-Id: default May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Domain-Name: Default May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Id: c1f81d15d7c54a30853ee3ff06b25bdd May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Name: admin May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: method: > May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: exception: Flavor 84 could not be found. May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: action_args: {'id': '84'} May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:29:24.672768 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:24.673553 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:24.675152 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-75457513-3beb-4fea-b330-878d4f550cd2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:29:24.676318 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-75457513-3beb-4fea-b330-878d4f550cd2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011919 May 27 09:29:24.676318 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Fri May 27 09:29:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:29:25.562777 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-564def8e-70c3-4e32-95ed-8c8956df21ed admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:25.563895 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-564def8e-70c3-4e32-95ed-8c8956df21ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001619 May 27 09:29:25.564401 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:29:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:29:25.758730 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-0e644b85-1a69-41ed-a149-d6a48a4ce353 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:25.764677 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.wsgi [None req-0e644b85-1a69-41ed-a149-d6a48a4ce353 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-0e644b85-1a69-41ed-a149-d6a48a4ce353 admin admin] Request method failure captured: May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Accept: application/json May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Accept-Encoding: gzip, deflate May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Connection: keep-alive May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Content-Length: 0 May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Host: 10.222.0.48 May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Openstack-Api-Version: compute 2.90 May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Openstack-System-Scope: None May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: User-Agent: python-novaclient May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Auth-Token: gAAAAABikJn1RZQCSZGgfTMudMIHLwkAIv0-SB62smLDHB_mqPnaLLfNtGh5uprFQZvkBDUfr-KETS_bwRwL_l_Vouqk7IoWeHRcu14Kj0mnWtFk6q7n6kRI8mIWdwYSdzQzpeQGutL37s9d0_8N4regTKI0SHcrlaqGrxJ4j0ugmPiwQxYCXKs May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Domain-Id: None May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Domain-Name: None May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Identity-Status: Confirmed May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Is-Admin-Project: True May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Domain-Id: default May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Domain-Name: Default May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Project-Name: admin May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Role: admin,reader,member May 27 09:29:25.766238 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Roles: admin,reader,member May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_822861f091c54d5980ee4872d75a26fa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Tenant: admin May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Tenant-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-Tenant-Name: admin May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User: admin May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Domain-Id: default May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Domain-Name: Default May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Id: c1f81d15d7c54a30853ee3ff06b25bdd May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: X-User-Name: admin May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: method: > May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: exception: Flavor 451 could not be found. May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: action_args: {'id': '451'} May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:29:25.767910 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:25.769447 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: ERROR nova.api.openstack.wsgi May 27 09:29:25.773755 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-0e644b85-1a69-41ed-a149-d6a48a4ce353 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103862) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:29:25.775011 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-0e644b85-1a69-41ed-a149-d6a48a4ce353 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063308 May 27 09:29:25.775011 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Fri May 27 09:29:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:29:25.779903 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-f3e4a60c-ccca-4581-b12b-c60e40b0e6aa admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:25.795767 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-f3e4a60c-ccca-4581-b12b-c60e40b0e6aa admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019347 May 27 09:29:25.796321 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Fri May 27 09:29:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:29:25.805979 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:25.820179 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017732 May 27 09:29:25.820726 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Fri May 27 09:29:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:29:25.833587 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-e2ea9ff9-195c-47c3-bac2-57182f759012 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:25.839268 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.wsgi [None req-e2ea9ff9-195c-47c3-bac2-57182f759012 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-e2ea9ff9-195c-47c3-bac2-57182f759012 admin admin] Request method failure captured: May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Accept: application/json May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Accept-Encoding: gzip, deflate May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Connection: keep-alive May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Content-Length: 0 May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Host: 10.222.0.48 May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Openstack-Api-Version: compute 2.90 May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Openstack-System-Scope: None May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: User-Agent: python-novaclient May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Auth-Token: gAAAAABikJn1RZQCSZGgfTMudMIHLwkAIv0-SB62smLDHB_mqPnaLLfNtGh5uprFQZvkBDUfr-KETS_bwRwL_l_Vouqk7IoWeHRcu14Kj0mnWtFk6q7n6kRI8mIWdwYSdzQzpeQGutL37s9d0_8N4regTKI0SHcrlaqGrxJ4j0ugmPiwQxYCXKs May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Domain-Id: None May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Domain-Name: None May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Identity-Status: Confirmed May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Is-Admin-Project: True May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Openstack-Nova-Api-Version: 2.90 May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Domain-Id: default May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Domain-Name: Default May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Project-Name: admin May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Role: admin,reader,member May 27 09:29:25.840751 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Roles: admin,reader,member May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/822861f091c54d5980ee4872d75a26fa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_822861f091c54d5980ee4872d75a26fa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Tenant: admin May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Tenant-Id: 822861f091c54d5980ee4872d75a26fa May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-Tenant-Name: admin May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User: admin May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Domain-Id: default May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Domain-Name: Default May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Id: c1f81d15d7c54a30853ee3ff06b25bdd May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: X-User-Name: admin May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: method: > May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: exception: Flavor 451 could not be found. May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: action_args: {'id': '451'} May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:29:25.842313 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:25.843127 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: ERROR nova.api.openstack.wsgi May 27 09:29:25.844172 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-e2ea9ff9-195c-47c3-bac2-57182f759012 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103861) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:29:25.845258 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-e2ea9ff9-195c-47c3-bac2-57182f759012 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012690 May 27 09:29:25.845258 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Fri May 27 09:29:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 27 09:29:26.713359 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:26.714404 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 27 09:29:26.714813 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:29:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:29:26.903733 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-908c9935-8f7b-41c2-9045-2a62ce5dc64f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:29:26.989655 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-908c9935-8f7b-41c2-9045-2a62ce5dc64f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.137299 May 27 09:29:26.990229 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Fri May 27 09:29:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:29:27.872265 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:27.873313 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 27 09:29:27.873718 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:29:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:29:28.068042 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-fd8788f2-15b4-410f-ad88-c8573bc0a06e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:29:28.157025 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-fd8788f2-15b4-410f-ad88-c8573bc0a06e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.143335 May 27 09:29:28.157511 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Fri May 27 09:29:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:29:29.027977 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:29.029031 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 May 27 09:29:29.029533 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:29:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:29:29.222527 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-ae70856f-2227-4bba-9e3d-1317b3c96078 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:29:29.332406 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-ae70856f-2227-4bba-9e3d-1317b3c96078 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.164278 May 27 09:29:29.332959 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Fri May 27 09:29:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:29:30.201308 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:30.202342 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 27 09:29:30.202747 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:29:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:29:30.394188 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-f5355a32-f148-459e-a7a1-817ac348db31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:29:30.528948 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-f5355a32-f148-459e-a7a1-817ac348db31 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.189305 May 27 09:29:30.529500 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Fri May 27 09:29:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:29:31.399293 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:31.400638 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001868 May 27 09:29:31.401150 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:29:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:29:31.591253 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-896b8460-b2da-4a1d-a550-13269d6a2997 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:29:31.610786 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-896b8460-b2da-4a1d-a550-13269d6a2997 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.070869 May 27 09:29:31.611240 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Fri May 27 09:29:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:30:34.347750 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:30:34.349415 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-5c14fb99-13da-4af8-8159-2b7f19f05233 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002093 May 27 09:30:34.349883 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Fri May 27 09:30:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:30:34.359902 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:34.422464 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-a4063ee7-8e51-4c8e-975e-d70d47383f55 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:30:34.445928 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-a4063ee7-8e51-4c8e-975e-d70d47383f55 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.088525 May 27 09:30:34.446560 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Fri May 27 09:30:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:30:34.473142 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-f1a7d625-a3cd-43ac-8089-5c0516f98200 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:30:34.476814 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG dbcounter [-] [103862] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103862) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:30:34.482644 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-f1a7d625-a3cd-43ac-8089-5c0516f98200 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015662 May 27 09:30:34.489141 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Fri May 27 09:30:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:30:34.495840 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-5479a229-45bc-4118-b48a-1ad4be40b044 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:30:34.504395 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-5479a229-45bc-4118-b48a-1ad4be40b044 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012111 May 27 09:30:34.504893 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Fri May 27 09:30:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:30:34.521328 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-7b62a36b-c52d-4fc2-8323-372bac79a743 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:30:34.535759 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-7b62a36b-c52d-4fc2-8323-372bac79a743 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.021805 May 27 09:30:34.538269 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Fri May 27 09:30:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:30:34.550658 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-c93142f9-d78b-4c5c-bb80-09d8ab8e38a3 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:30:34.565137 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-c93142f9-d78b-4c5c-bb80-09d8ab8e38a3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017941 May 27 09:30:34.566010 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Fri May 27 09:30:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:34:21.795795 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-7b62a36b-c52d-4fc2-8323-372bac79a743 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:34:21.796809 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-7b62a36b-c52d-4fc2-8323-372bac79a743 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 27 09:34:21.797213 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:34:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:34:21.951536 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_api:SELECT=6 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:34:22.064861 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-3fef550b-20a7-436f-a840-917301f38c0c admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:34:22.066028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:34:22.066028 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: warnings.warn(msg) May 27 09:34:22.067954 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-3fef550b-20a7-436f-a840-917301f38c0c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:34:22.068391 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-3fef550b-20a7-436f-a840-917301f38c0c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:34:22.069487 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-3fef550b-20a7-436f-a840-917301f38c0c admin admin] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:34:22.069912 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-3fef550b-20a7-436f-a840-917301f38c0c admin admin] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:34:22.102870 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-3fef550b-20a7-436f-a840-917301f38c0c admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.152664 May 27 09:34:22.103363 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Fri May 27 09:34:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:34:22.976587 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-7b62a36b-c52d-4fc2-8323-372bac79a743 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:34:22.977397 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-7b62a36b-c52d-4fc2-8323-372bac79a743 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 27 09:34:22.978116 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:34:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:34:23.172526 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-3ad0144e-9e1d-476e-9c5a-ecedcc5f9b84 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:34:23.177072 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:34:23.177072 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: warnings.warn(msg) May 27 09:34:23.177072 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-3ad0144e-9e1d-476e-9c5a-ecedcc5f9b84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:34:23.177072 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-3ad0144e-9e1d-476e-9c5a-ecedcc5f9b84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:34:23.177072 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-3ad0144e-9e1d-476e-9c5a-ecedcc5f9b84 admin admin] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:34:23.177072 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-3ad0144e-9e1d-476e-9c5a-ecedcc5f9b84 admin admin] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:34:23.197339 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-3ad0144e-9e1d-476e-9c5a-ecedcc5f9b84 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076853 May 27 09:34:23.197821 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Fri May 27 09:34:23 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:34:34.483751 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-7b62a36b-c52d-4fc2-8323-372bac79a743 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:34:34.484767 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-7b62a36b-c52d-4fc2-8323-372bac79a743 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 27 09:34:34.485170 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:34:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:34:34.627676 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_cell0:SELECT=4 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:34:34.628405 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_cell1:SELECT=4 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:34:34.629055 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG dbcounter [-] [103861] Writing DB stats nova_api:SELECT=8 {{(pid=103861) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:34:34.679328 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-8658cf53-5cbc-44e3-b29b-9a97700b1790 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:34:34.680486 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:34:34.680486 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: warnings.warn(msg) May 27 09:34:34.681992 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-8658cf53-5cbc-44e3-b29b-9a97700b1790 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:34:34.682451 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-8658cf53-5cbc-44e3-b29b-9a97700b1790 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:34:34.683522 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-8658cf53-5cbc-44e3-b29b-9a97700b1790 admin admin] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:34:34.684035 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-8658cf53-5cbc-44e3-b29b-9a97700b1790 admin admin] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:34:34.709506 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-8658cf53-5cbc-44e3-b29b-9a97700b1790 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.086112 May 27 09:34:34.709987 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Fri May 27 09:34:34 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:34:35.597163 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: DEBUG nova.api.openstack.wsgi [None req-7b62a36b-c52d-4fc2-8323-372bac79a743 admin admin] Calling method '>' {{(pid=103862) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:34:35.598907 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: INFO nova.api.openstack.requestlog [None req-7b62a36b-c52d-4fc2-8323-372bac79a743 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002194 May 27 09:34:35.599361 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: [pid: 103862|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Fri May 27 09:34:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:34:35.798447 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG nova.api.openstack.wsgi [None req-00becea9-4bb0-4657-95f4-80ab96906977 admin admin] Calling method '>' {{(pid=103861) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:34:35.799611 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 27 09:34:35.799611 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: warnings.warn(msg) May 27 09:34:35.800860 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-00becea9-4bb0-4657-95f4-80ab96906977 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:34:35.801304 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-00becea9-4bb0-4657-95f4-80ab96906977 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:34:35.802146 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-00becea9-4bb0-4657-95f4-80ab96906977 admin admin] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:34:35.802598 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: DEBUG oslo_concurrency.lockutils [None req-00becea9-4bb0-4657-95f4-80ab96906977 admin admin] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103861) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:34:35.824944 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: INFO nova.api.openstack.requestlog [None req-00becea9-4bb0-4657-95f4-80ab96906977 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080853 May 27 09:34:35.825525 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: [pid: 103861|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Fri May 27 09:34:35 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:35:34.480155 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: Fri May 27 09:35:34 2022 - graceful shutdown triggered... May 27 09:35:34.480672 dv-cinder-825492-18-iscsi devstack@n-api.service[103861]: Gracefully killing worker 1 (pid: 103861)... May 27 09:35:34.480266 dv-cinder-825492-18-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 27 09:35:34.481688 dv-cinder-825492-18-iscsi devstack@n-api.service[103862]: Gracefully killing worker 2 (pid: 103862)... May 27 09:35:35.481266 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: worker 1 buried after 1 seconds May 27 09:35:35.481266 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: worker 2 buried after 1 seconds May 27 09:35:35.481266 dv-cinder-825492-18-iscsi devstack@n-api.service[103860]: goodbye to uWSGI. May 27 09:35:35.482992 dv-cinder-825492-18-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 27 09:35:35.483578 dv-cinder-825492-18-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 27 09:35:35.487084 dv-cinder-825492-18-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 27 09:35:35.506083 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 27 09:35:35 2022] *** May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: nodename: dv-cinder-825492-18-iscsi May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: machine: x86_64 May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: clock source: unix May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: pcre jit disabled May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: detected number of CPU cores: 4 May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: current working directory: / May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: detected binary path: /usr/bin/uwsgi-core May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: your processes number limit is 47680 May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: your memory page size is 4096 bytes May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: detected max file descriptor number: 2048 May 27 09:35:35.519066 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: lock engine: pthread robust mutexes May 27 09:35:35.520120 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: thunder lock: enabled May 27 09:35:35.520120 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 27 09:35:35.520120 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 27 09:35:35.568659 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: Python main interpreter initialized at 0x55ae7b8d49c0 May 27 09:35:35.568659 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: python threads support enabled May 27 09:35:35.568659 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: your server socket listen backlog is limited to 100 connections May 27 09:35:35.568659 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: your mercy for graceful operations on workers is 90 seconds May 27 09:35:35.569102 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: mapped 403077 bytes (393 KB) for 2 cores May 27 09:35:35.569102 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: *** Operational MODE: preforking *** May 27 09:35:35.569370 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: *** uWSGI is running in multiple interpreter mode *** May 27 09:35:35.569370 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: spawned uWSGI master process (pid: 124809) May 27 09:35:35.569582 dv-cinder-825492-18-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 27 09:35:35.570636 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: spawned uWSGI worker 1 (pid: 124828, cores: 1) May 27 09:35:35.570636 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: spawned uWSGI worker 2 (pid: 124829, cores: 1) May 27 09:35:35.571007 dv-cinder-825492-18-iscsi devstack@n-api.service[124809]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 27 09:35:36.758653 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 09:35:36.764169 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 27 09:35:37.557340 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:35:37.557340 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: from cryptography.utils import int_from_bytes May 27 09:35:37.557668 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:35:37.557668 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: from cryptography.utils import int_from_bytes May 27 09:35:37.557802 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:35:37.557802 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: from cryptography.utils import int_from_bytes May 27 09:35:37.558180 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 27 09:35:37.558180 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: from cryptography.utils import int_from_bytes May 27 09:35:39.975954 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:35:39.976551 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:35:39.976827 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:35:39.977106 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:35:39.977427 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:35:39.977752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.978082 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.978437 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.978763 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.979100 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.979419 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.979745 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.980069 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.980166 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 27 09:35:39.980528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 27 09:35:39.980615 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.980690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.980882 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 27 09:35:39.980988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.981237 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 27 09:35:39.981343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-18-iscsi {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.981500 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 27 09:35:39.981612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.981879 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.981993 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.982186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.982410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.982565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.982669 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.982839 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.982943 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.983164 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.983274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.983477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.983604 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.983853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.984033 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.984155 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.985350 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.985619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.985866 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.986793 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.987036 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.987261 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.987481 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-18-iscsi {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.987709 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.987941 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.987941 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.988381 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.988381 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.988810 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.988810 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.989224 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.989443 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.989651 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.989860 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.990080 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.990320 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.990562 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.990562 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-18-iscsi {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.990980 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.991213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.991422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.991604 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.991761 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.991950 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.992112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.992112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.992396 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.992396 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.992742 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.992900 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.993064 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.993223 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.993369 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.993513 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.993689 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.993835 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.994046 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.994812 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.995170 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.995332 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.995487 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-18-iscsi {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.995660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.995815 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.995983 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.996143 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.996297 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.996453 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.996613 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.996829 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.996981 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.997137 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.997336 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.997496 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.997662 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.997815 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.997972 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.998118 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.998294 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.998456 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.998613 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.998757 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.998901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.999053 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.999199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.999357 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.999512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.999512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:39.999803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.000540 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.000715 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.000870 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.001025 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.001177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.001326 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.001470 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.001628 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.001781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.001938 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.002083 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.002262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.002425 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.002585 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.002731 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.002886 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.003031 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.003184 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.003344 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.003502 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.003648 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.003792 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.003959 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.004113 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.004113 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.005099 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.005256 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.005414 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.005562 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.005726 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.005928 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.006086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.006264 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.006417 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.006582 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.006742 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.006889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.007041 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.007186 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.007330 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.007475 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.007629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.007782 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.007935 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.008094 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.008240 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.008395 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.008548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.008694 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.008839 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.008981 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.009125 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.009349 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.009502 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.009648 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.009800 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.009955 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.010112 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.010331 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.010504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.010725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.010885 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.011038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.011183 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.011183 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.011477 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.011477 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.011771 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.011771 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.012053 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.012209 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.012361 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.012524 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.012677 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.012822 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.012978 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.013136 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.013290 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.013443 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.013587 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.013730 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.013886 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.014031 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.014184 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.014184 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.014521 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.015318 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.015493 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.015649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.015795 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.015961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.016119 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.016273 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.016444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.016600 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.016754 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.016907 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.017072 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.017218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.017380 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.017533 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.017686 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.017831 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.017974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.018135 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.018331 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.018485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.018631 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.018785 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.018938 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.019095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.019251 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.019396 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.019555 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.019709 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.019855 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.020009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.020163 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.020308 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.020466 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.020613 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.020757 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.020901 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.021060 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.021214 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.021372 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.021525 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.021671 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.021828 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.021974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.022118 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.022286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.022444 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.022598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.022752 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.022906 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.023062 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.023216 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.023363 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.023522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.023676 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.023822 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.023966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.024118 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.024271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.024431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.024584 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.024747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.025565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.025735 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.025896 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.026061 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.026336 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.026495 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.026653 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.026807 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.026960 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.027120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.027267 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.027412 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.027558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.027703 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.027860 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.028022 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.028176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.028176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.028459 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.028605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.028764 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.028919 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.029071 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.029217 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.029369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.029527 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.029699 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.029852 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.030005 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.030151 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.030329 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.030477 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.030633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.030788 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.030932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.031076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 27 09:35:40.031231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.031385 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.031530 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.031687 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.031832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.031975 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.032119 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.032278 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.032431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.032584 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.032740 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.032894 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.033553 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.033709 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.033863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.034019 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.034173 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.034379 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.034537 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.034699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.034859 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.035024 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.035954 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.036112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.036269 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.036415 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.036569 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.036723 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.036888 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.037042 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.037188 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.037416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.037572 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.037725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.037871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.038025 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.038171 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.038358 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.038512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.038659 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.038815 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.038959 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.039112 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.039272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.039425 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.039578 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.039723 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.039868 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.040013 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.040171 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.040318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.040463 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.040615 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.040771 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.040925 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.041082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.041236 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.041391 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.041543 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.041697 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.041851 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.041997 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.042150 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.042334 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.042480 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.042624 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.042796 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.042951 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.043104 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.043297 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.043442 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.043594 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.043750 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.043931 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.044684 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.044851 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.045005 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.045152 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.046012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.046182 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.046366 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.046536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.047386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.047558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.047707 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.047860 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.048006 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.048151 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.048316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.048480 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.049188 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.049349 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.049509 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.049664 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.049810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.049965 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.050119 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.050320 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.050489 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.050641 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.050786 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.050954 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.051108 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.051255 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.051410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.051564 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.051719 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.051866 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.052011 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.052155 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.052299 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.052451 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.052608 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.052765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.052911 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.053056 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.053207 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.053371 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.053531 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.053680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.053825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.053979 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.054132 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.054319 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.054477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.054632 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.054786 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.054939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.055091 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.055253 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.055253 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.056290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.056290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.056825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.056825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.057118 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.057272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.057418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.057571 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.057726 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.057881 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.058040 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.058262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.058427 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.058574 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.058718 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.058862 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.059041 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.059327 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.059492 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.059647 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.059793 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.059953 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.060109 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.060264 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.060431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.060578 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.060722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.060876 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.061031 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.061177 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.061329 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.061475 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.061619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.061773 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.061980 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.062141 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.062324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.062490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.062636 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.062636 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.062933 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.063087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.063233 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.063233 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.063527 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.063680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.063833 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.063986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.064132 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.064507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.064683 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.064831 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.065561 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.066432 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.066700 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.066855 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.067023 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.067171 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.067325 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.067480 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.067626 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.067771 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.067925 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.068090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.068245 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.068393 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.068546 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.068701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.068855 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.069009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.069163 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.069309 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.069455 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.069610 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.069756 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.069911 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.070056 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.070243 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.070396 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.070559 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.070716 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.070862 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.071007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.071151 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.071295 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.071528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.071685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.071838 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.071996 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.072142 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.072301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.072455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.072603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.072756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.072908 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.073062 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.073217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.073364 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.073508 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.073661 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.073814 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.073976 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.074135 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.074316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.074464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.074617 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.074763 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.074907 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.075065 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.075217 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.075363 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.075507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.075651 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.075825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.076552 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.076733 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.077044 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.077209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.077356 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.077518 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.077666 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.077811 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.077956 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.078100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.078100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.078424 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.078583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.078752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.078908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.079053 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.079205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.079365 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.079518 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.079663 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.080349 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.080509 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.080656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.080810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.080964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.081127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.081273 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.081418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.081570 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.081723 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.081871 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.082024 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.082208 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.082364 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.082521 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.082667 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.082826 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.082987 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.083153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.083304 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.083469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.083622 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.083779 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.083937 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.084090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.084241 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.084402 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.084560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.084712 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.084869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.084968 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.085221 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.085479 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.085611 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.085748 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.085886 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.086765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.086955 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.087198 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.087338 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.087479 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.087611 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.087758 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.087907 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.088040 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.088171 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.088303 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.088440 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.088572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.088717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.088850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.088980 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.089111 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.089249 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.089396 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.089536 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.089676 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.089808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.089946 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.090086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.090242 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.090389 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.090522 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.090660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.090800 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.090938 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.091078 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.091219 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.091358 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.091491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.091629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.091761 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.091902 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.092042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.092173 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.092304 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.092445 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.092445 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.092716 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.092716 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.092974 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.093112 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.093244 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.093384 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.093524 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.093656 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.093786 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.093916 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.094045 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.094184 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.094331 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.094474 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.094615 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.094755 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.094886 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.095030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.095162 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.095300 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.095503 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.096128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.096285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.096986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.097125 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.097407 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.097544 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.097683 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.097826 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.097972 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.098112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.098112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.098423 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.098580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.098580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.098885 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.099024 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.099157 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.099157 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.099421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.099421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.099421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.100358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.100494 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.100626 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.100767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.100767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.101109 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.101241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.101371 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.101501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.101501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.101765 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.101905 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.101905 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.102174 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.102324 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.102455 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.102586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.102586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.102932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.103076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.103076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.103338 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.103483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.103483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.103749 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.103889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.104024 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.104155 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.104155 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.104421 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.104560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.104560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.104817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.104963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.104963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.105233 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.105366 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.105497 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.105629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.105629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.105893 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.106077 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.106077 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.106381 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.106528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.106528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.107352 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.107572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.107717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.107850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.107850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.108113 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.108249 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.108249 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.108552 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.108700 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.109427 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.109583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.109728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.109869 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.110003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.110142 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.110142 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.110593 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.110729 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.110729 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.110976 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.111140 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.111284 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.111419 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.111419 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.111675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.111807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.111938 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.112082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.112082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.112332 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.112473 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.112473 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.112731 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.112872 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.112872 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.113121 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.113260 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.113392 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.113534 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.113534 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.113790 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.113930 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.113930 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.114188 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.114365 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.114365 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.114626 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.114757 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.114757 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.115003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.115144 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.115284 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.115416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.115416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.115680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.115821 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.115821 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.116078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.116209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.116209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.116478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.116627 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.118297 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.118448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.118594 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.118731 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.118863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.119010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.119010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.119280 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.119422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.119422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.119422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.119809 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.119951 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.120108 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.121176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.121330 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.121481 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.121481 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.121732 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.121872 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.122005 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.122136 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.122136 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.122433 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.122567 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.122567 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.122814 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.122955 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.122955 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.123223 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.123357 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.123357 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.123613 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.123744 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.124124 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.124270 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.124270 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.124521 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.124661 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.124661 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.124931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.125065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.125065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.125312 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.125443 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.125584 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.125716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.125716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.125978 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.126112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.126112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.126463 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.126604 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.126604 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.127433 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.127583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.127725 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.127868 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.128001 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.128134 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.128505 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.128643 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.128789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.128923 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.129054 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.129187 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.129187 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.129435 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.129580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.129580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.129845 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.129986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.130126 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.130474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.130474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.130746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.130886 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.131025 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.131172 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.131383 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.131529 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.131671 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.131803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.131803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.132075 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.132216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.132216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.132477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.132703 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.132846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.133506 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.133506 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.134230 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.134365 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.134509 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.134643 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.134643 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.134905 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.135046 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.135046 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.135866 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.136013 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.136013 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.136271 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.136404 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.138013 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.138171 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.138171 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.138684 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.138827 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.138961 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.139104 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.139247 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.139394 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.139394 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.139645 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.139776 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.140304 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.140885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.141031 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.141173 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.141173 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.141534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.141673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.141673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.141931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.142073 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.142073 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.143002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.143137 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.143313 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.143447 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.143447 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.143694 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.144700 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.144853 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.144997 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.144997 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.145257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.145390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.145390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.145649 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.145780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.145911 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.146051 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.146207 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.146354 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.146496 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.146637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.146637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.146903 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.147051 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.147184 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.147323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.147323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.147581 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.147727 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.148379 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.148519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.149024 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.149168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.149168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.149438 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.149581 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.149728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.149869 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.150459 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.150622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.150769 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.150911 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.151043 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.151191 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.151338 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.151472 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.151721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.151858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.151858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.152108 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.152250 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.152250 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.152511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.152644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.152776 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.152915 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.153048 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.153188 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.153336 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.153471 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.153471 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.153718 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.153849 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.153973 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.154107 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.154107 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.154429 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.155569 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.155715 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.155867 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.155867 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.156131 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.156272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.157248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.157404 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.157553 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.157699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.157699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.158038 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.159189 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.159328 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.159482 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.159482 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.159746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.159880 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.159880 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.160144 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.160277 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.160277 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.160543 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.160686 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.160819 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.160960 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.160960 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.161208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.161350 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.161484 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.161623 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.161844 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.162049 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.162049 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.162396 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.162540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.162540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.162801 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.162922 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.163060 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.163199 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.163199 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.163465 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.163596 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.163733 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.163867 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.164006 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.164152 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.164292 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.164433 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.164565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.164696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.164828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.164972 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.164972 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.165228 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.165361 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.165501 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.165646 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.165780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.165912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.166050 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.166183 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.166331 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.166475 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.166623 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.166756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.166898 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.167031 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.167170 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.167312 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.167445 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.167576 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.167715 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.167847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.167980 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.168188 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.168331 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.168472 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.168605 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.169176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.169407 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.169545 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.169684 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.169825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.169958 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.170100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.170100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.170488 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.170630 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.170630 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.170889 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.171022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.171174 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.171308 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.171430 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.171571 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.171886 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.172074 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.172209 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.172325 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.172444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.172566 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.172688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.172812 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.172926 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.173046 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.173161 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.173282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.173396 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.173661 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.173790 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.173905 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.174018 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.174131 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.174278 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.174413 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.174528 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.174650 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.174772 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.174894 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.174894 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.175147 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.175261 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.175374 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.175498 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.175626 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.175754 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.175877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.176015 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.176130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.176243 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.176355 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.176476 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.176601 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.176601 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.176818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.176932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.177056 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.177194 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.177322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.177444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.177570 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.177682 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.177825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.177973 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.178107 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.178280 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.178424 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.178566 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.178709 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.178709 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.179446 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.179690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.179828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.179969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.180118 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.180252 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.180391 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.180534 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.180675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.180818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.180964 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.180964 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.181215 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.181215 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.181477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.181878 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.182022 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.182281 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.182920 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.183054 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.183179 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.183304 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.183424 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.183566 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.183566 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.183566 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.183957 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.184091 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.184222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.184353 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.184485 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.184626 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.184769 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.184902 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.185034 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.185174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.185174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.185424 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.185565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.185699 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.185841 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.185982 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.186122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.186316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.186462 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.186596 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.186736 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.186870 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.187002 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.187002 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.187002 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.187002 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.187515 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.187649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.187788 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.187930 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.188063 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.188194 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.188333 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.188466 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.188598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.188738 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.188878 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.189019 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.189594 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.189843 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.189992 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.190128 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.190287 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.190423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.190423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.190423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.190797 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.190930 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.191070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.191204 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.191356 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.191490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.191631 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.191764 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.191764 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.192029 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.192163 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.192379 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.192527 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.192660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.192799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.192932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.192932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.193191 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.193336 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.193478 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.193618 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.193751 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.193883 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.194028 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.194162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.194392 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.194537 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.194672 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.194812 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.195067 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.195210 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.195373 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.195533 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.195670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.195670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.196007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.196143 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.196276 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.196407 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.196537 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.196682 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.196815 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.196955 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.197096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.197236 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.197378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.197564 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.197708 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.197841 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.197980 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.198121 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.198268 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.198416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.198549 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.198689 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.198829 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.198970 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.199103 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.199259 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.199796 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.200034 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.200181 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.200322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.200458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.200606 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.200606 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.200874 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.201016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.201158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.201311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.201445 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.201587 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.201587 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.202026 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.202284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.202614 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.202765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.202908 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.203047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.203186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.203326 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.203468 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.203609 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.203742 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.203880 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.204012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.204012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.204269 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.204269 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.204532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.204707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.205361 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.205511 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.205654 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.205790 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.205922 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.206054 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.206185 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.206349 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.206494 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.206628 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.206761 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.206893 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.207040 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.207174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.207314 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.207314 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.207567 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.207698 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.207845 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.207986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.208120 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.208352 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.208498 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.208632 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.208777 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.208912 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.209058 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.209191 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.209330 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.209486 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.209982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.210273 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.210273 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.210546 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.210688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.210831 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.210966 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.211106 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.211246 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.211380 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.211519 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.211675 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.211821 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.212023 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.212023 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.212320 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.212472 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.212688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.212824 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.212956 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.213097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.213237 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.213384 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.213517 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.213649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.213788 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.213929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.213929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.214207 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.214354 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.214488 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.214620 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.214759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.214907 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.215571 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.215716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.215857 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.215999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.216140 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.216284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.216417 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.216538 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.216684 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.216826 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.216969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.217116 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.217251 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.217382 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.217513 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.217654 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.217794 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.217937 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.218072 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.218263 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.218400 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.218546 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.218689 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.218838 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.218979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.219112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.219252 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.219386 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.219386 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.219655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.220140 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.220372 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.221062 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.221198 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.221340 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.221504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.221652 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.221787 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.221920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.222138 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.222290 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.222435 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.222571 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.222729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.222927 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.223074 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.223216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.223373 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.223373 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.224117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.224262 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.224411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.224411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.224664 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.224796 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.224928 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.225076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.225219 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.225361 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.225493 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.225627 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.225750 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.226050 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.226249 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.226387 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.226520 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.226660 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.226802 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.226950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.227097 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.227231 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.227370 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.227504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.227644 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.227797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.227939 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.228091 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.228232 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.228366 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.228498 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.228645 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.228788 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.228929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.229062 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.229194 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.229334 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.229476 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.229617 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.229750 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.229884 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.230352 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.230549 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.230693 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.230828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.230984 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.230984 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.231329 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.231472 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.231605 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.231737 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.231868 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.232030 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.232248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.232394 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.232529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.232661 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.232793 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.232952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.233165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.233312 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.233446 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.233579 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.233710 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.233842 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.233987 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.234136 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.234351 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.234487 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.234620 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.234751 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.234751 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.235011 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.235152 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.235292 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.235425 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.235557 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.235702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.235835 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.235967 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.236121 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.236263 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.236406 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.236547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.236692 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.236834 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.236967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.237108 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.237255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.237397 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.237531 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.237663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.237803 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.237951 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.238094 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.238273 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.238419 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.238561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.238702 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.238845 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.238979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.239119 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.239254 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.239394 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.239527 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.239679 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.239822 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.239963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.240120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.240590 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.240734 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.240879 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.241018 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.241162 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.241402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.241549 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.241692 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.241835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.241977 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.242122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.242285 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.242486 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.242632 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.242766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.242897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.243028 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.243174 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.243409 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.243556 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.243691 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.243831 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.243964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.244096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.244096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.244373 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.244508 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.244639 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.244771 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.244913 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.244913 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245188 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245321 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245460 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245602 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124828) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:35:40.245737 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245737 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245737 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245737 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245737 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245737 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245737 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.245737 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.246778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.246778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.246778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.246778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.246778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.246778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.246778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.246778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.247781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.247781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.247781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.247781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.247781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.247781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.247781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.247781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.248789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.248789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.248789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.248789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.248789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.248789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.248789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.248789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.249759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.249759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.249759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.249759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.249759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.250785 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.250785 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.250785 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.251173 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.251357 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.251702 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.252033 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.252351 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.252684 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.252998 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.253328 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.253659 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.253984 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.254326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.254665 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.254985 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.255306 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.255652 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.255972 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.256293 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.256611 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.256946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.257281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.257596 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.257959 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.258315 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.258647 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.258971 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.259290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.259631 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.260240 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.260718 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.260874 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.261178 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.261496 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.261823 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.262246 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.262508 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.262846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.263162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.263496 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.263831 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.264188 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.264585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.264946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.265285 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.265608 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.265927 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.266262 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 27 09:35:40.266515 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 27 09:35:40.298120 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO dbcounter [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Registered counter for database nova_api May 27 09:35:40.319092 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_db.sqlalchemy.engines [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:35:40.326368 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writer thread running {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:35:40.327007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO dbcounter [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Registered counter for database nova_api May 27 09:35:40.348342 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_db.sqlalchemy.engines [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:35:40.356139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writer thread running {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:35:40.382769 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.context [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35(cell1) {{(pid=124828) load_cells /opt/stack/nova/nova/context.py:464}} May 27 09:35:40.386909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:35:40.388590 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:35:40.389449 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:35:40.391499 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:35:40.394015 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO dbcounter [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Registered counter for database nova_cell0 May 27 09:35:40.398188 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO dbcounter [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Registered counter for database nova_cell1 May 27 09:35:40.407241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_db.sqlalchemy.engines [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:35:40.409001 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_db.sqlalchemy.engines [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:35:40.414029 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.context [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35(cell1) {{(pid=124829) load_cells /opt/stack/nova/nova/context.py:464}} May 27 09:35:40.415792 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writer thread running {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:35:40.417098 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writer thread running {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:35:40.418267 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:35:40.419870 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:35:40.420688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:35:40.422704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:35:40.424704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO dbcounter [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Registered counter for database nova_cell0 May 27 09:35:40.428819 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO dbcounter [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Registered counter for database nova_cell1 May 27 09:35:40.436443 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_db.sqlalchemy.engines [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:35:40.438359 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_db.sqlalchemy.engines [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:35:40.445067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writer thread running {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:35:40.446722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writer thread running {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:35:40.562553 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO dbcounter [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Registered counter for database nova_cell0 May 27 09:35:40.573368 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_db.sqlalchemy.engines [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124828) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:35:40.578076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writer thread running {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:35:40.594160 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO dbcounter [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Registered counter for database nova_cell0 May 27 09:35:40.603884 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_db.sqlalchemy.engines [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 27 09:35:40.608485 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writer thread running {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 27 09:35:40.908287 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: WARNING keystonemiddleware.auth_token [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:35:40.918034 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: WARNING keystonemiddleware.auth_token [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:35:40.932591 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: WARNING keystonemiddleware.auth_token [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:35:40.940909 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: WARNING keystonemiddleware.auth_token [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:35:41.262288 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: WARNING keystonemiddleware.auth_token [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:35:41.268267 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: WARNING keystonemiddleware.auth_token [None req-40fbc59b-79e9-491a-b3d1-2b780a91a93b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:35:41.274091 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae7b8d49c0 pid: 124828 (default app) May 27 09:35:41.288434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: WARNING keystonemiddleware.auth_token [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 27 09:35:41.294905 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: WARNING keystonemiddleware.auth_token [None req-bff14613-3118-4b72-877e-b8b6dab729c7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 27 09:35:41.300887 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ae7b8d49c0 pid: 124829 (default app) May 27 09:36:24.357800 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:24.359567 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:24.361035 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:24.363133 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:24.576715 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=3 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:24.583369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=3 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:24.585754 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=3 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:24.588344 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=3 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:25.720497 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-40a571a6-2a9c-44e0-884d-f2f719da6252 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Action: 'create', calling method: .version_select at 0x7fbe343f8ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2241733"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:25.986836 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-63cf8560-bce1-468b-a39f-3d331db78082 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Action: 'create', calling method: .version_select at 0x7fbe343fbc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-723033193", "metadata": {"Type": "work"}}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:27.945978 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-40a571a6-2a9c-44e0-884d-f2f719da6252 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 342 microversion: 2.1 time: 3.625367 May 27 09:36:27.948216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1154 bytes} [Fri May 27 09:36:24 2022] POST /compute/v2.1/os-volumes => generated 342 bytes in 3631 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 09:36:27.973217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-63cf8560-bce1-468b-a39f-3d331db78082 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.413953 May 27 09:36:27.974883 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 1/2] 10.222.0.48 () {60 vars in 1155 bytes} [Fri May 27 09:36:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3418 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 27 09:36:27.981560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-33ca7d98-31b1-4b11-8312-730cc3bb465b tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe3424bb80>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:28.177293 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-33ca7d98-31b1-4b11-8312-730cc3bb465b tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/b0d249c8-1b36-4696-a3d5-8b7634302f3d" status: 200 len: 350 microversion: 2.1 time: 0.200922 May 27 09:36:28.186676 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:27 2022] GET /compute/v2.1/os-volumes/b0d249c8-1b36-4696-a3d5-8b7634302f3d => generated 350 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:28.192464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1495d429-1373-44ee-b8ce-04f9a370d23b tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe3424bd30>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:28.237542 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1769223594", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "networks": [{"uuid": "4beb7aea-7257-4b27-b5ef-cfa7a8e94cfe"}]}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:28.436832 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] validate_networks() for [('4beb7aea-7257-4b27-b5ef-cfa7a8e94cfe', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:36:28.936660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1495d429-1373-44ee-b8ce-04f9a370d23b tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14" status: 200 len: 343 microversion: 2.1 time: 0.746311 May 27 09:36:28.936660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:28 2022] GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 => generated 343 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:28.940688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-54d3266f-b29c-4544-a878-b2274dc4b2a6 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Calling method '.version_select at 0x7fbe3425c430>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:29.056240 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-54d3266f-b29c-4544-a878-b2274dc4b2a6 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3" status: 200 len: 353 microversion: 2.1 time: 0.119635 May 27 09:36:29.057204 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 4/5] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:28 2022] GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:29.062310 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b35012dc-f70b-4dc3-86a2-1c88f566405c tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Action: 'create', calling method: .version_select at 0x7fbe3425ca60>, body: {"snapshot": {"volume_id": "119619e1-7748-4d48-a67d-58a333e28d14", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1645126619"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:29.623719 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:36:29.626785 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:36:29.628012 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:36:29.629095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:36:29.629976 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:36:29.671687 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:29.672059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:29.686783 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:29.687875 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:29.728467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b35012dc-f70b-4dc3-86a2-1c88f566405c tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.669982 May 27 09:36:29.729277 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 5/6] 10.222.0.48 () {60 vars in 1161 bytes} [Fri May 27 09:36:29 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:29.735785 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-505da488-3e81-4b5f-bfe9-5240b26fc0ee tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Calling method '.version_select at 0x7fbe3425cca0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:29.766752 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Getting quotas for project 56f6fbec499344859b9da684d29ffdb8. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:36:29.775007 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Getting quotas for user 2ca8c6589d0a4bbb9c5adf780cbd2fd8 and project 56f6fbec499344859b9da684d29ffdb8. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:36:29.803161 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:36:29.807393 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:36:29.911715 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-505da488-3e81-4b5f-bfe9-5240b26fc0ee tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3" status: 200 len: 353 microversion: 2.1 time: 0.180418 May 27 09:36:29.912286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 6/7] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:29 2022] GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 => generated 353 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:29.918769 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c84fb27e-926f-4ce3-9f7d-4d9adf45543f tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe3425c430>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:30.000092 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c84fb27e-926f-4ce3-9f7d-4d9adf45543f tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7" status: 200 len: 287 microversion: 2.1 time: 0.086200 May 27 09:36:30.001663 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 7/8] 10.222.0.48 () {58 vars in 1250 bytes} [Fri May 27 09:36:29 2022] GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:30.007780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-92d01430-0c91-48a8-beae-bbf19f4b4174 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Calling method '.version_select at 0x7fbe3424bc10>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:30.096673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3cc98f37-af26-4f93-8a7e-e0a6424fff0e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.146597 May 27 09:36:30.102797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 2/9] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:36:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:36:30.118321 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8ca1e320-094d-4600-8c70-b5756ea5ac5c tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe339645e0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:30.435073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-92d01430-0c91-48a8-beae-bbf19f4b4174 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3" status: 202 len: 0 microversion: 2.1 time: 0.429131 May 27 09:36:30.435073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 8/10] 10.222.0.48 () {58 vars in 1247 bytes} [Fri May 27 09:36:30 2022] DELETE /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:36:30.441203 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c66edee5-1621-48f4-9c29-45d92621ecd8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:30.442124 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c66edee5-1621-48f4-9c29-45d92621ecd8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:30.578177 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8ca1e320-094d-4600-8c70-b5756ea5ac5c tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.474006 May 27 09:36:30.579133 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 3/11] 10.222.0.48 () {58 vars in 1139 bytes} [Fri May 27 09:36:30 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:30.584195 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-40e6826a-1493-4afa-aea3-6b95426f2da2 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Calling method '.version_select at 0x7fbe339648b0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:30.675607 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c66edee5-1621-48f4-9c29-45d92621ecd8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:30.699152 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-40e6826a-1493-4afa-aea3-6b95426f2da2 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3" status: 200 len: 352 microversion: 2.1 time: 0.118728 May 27 09:36:30.699724 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 4/12] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:30 2022] GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 => generated 352 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:30.700713 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c66edee5-1621-48f4-9c29-45d92621ecd8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1215 microversion: 2.1 time: 0.266483 May 27 09:36:30.704866 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 9/13] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:30 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1215 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:30.709333 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-76f53fe8-04d6-4a32-a736-50d7b5cc635d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe33964280>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:30.831315 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-76f53fe8-04d6-4a32-a736-50d7b5cc635d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7" status: 200 len: 287 microversion: 2.1 time: 0.126081 May 27 09:36:30.832099 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 5/14] 10.222.0.48 () {58 vars in 1250 bytes} [Fri May 27 09:36:30 2022] GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 => generated 287 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:31.711150 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-23e8ea2d-5e2b-4b23-82af-580c1e148645 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Calling method '.version_select at 0x7fbe3425caf0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:31.721371 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4924bd39-b3b5-4d0b-a841-a44d5338a11f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:31.722000 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4924bd39-b3b5-4d0b-a841-a44d5338a11f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:31.881823 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-23e8ea2d-5e2b-4b23-82af-580c1e148645 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3" status: 200 len: 352 microversion: 2.1 time: 0.173976 May 27 09:36:31.887873 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 10/15] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:31 2022] GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 => generated 352 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:31.896899 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-33494d06-d6e0-4ff5-96cc-7301eb315039 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe342268b0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:31.996558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4924bd39-b3b5-4d0b-a841-a44d5338a11f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:32.012009 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-33494d06-d6e0-4ff5-96cc-7301eb315039 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7" status: 200 len: 287 microversion: 2.1 time: 0.122968 May 27 09:36:32.016759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 11/16] 10.222.0.48 () {58 vars in 1250 bytes} [Fri May 27 09:36:31 2022] GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 => generated 287 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:32.034682 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4924bd39-b3b5-4d0b-a841-a44d5338a11f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1215 microversion: 2.1 time: 0.314561 May 27 09:36:32.036771 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 6/17] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:31 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1215 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:36:32.895450 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-68a0055d-a723-4667-93cd-4422683eaa9e tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Calling method '.version_select at 0x7fbe34226f70>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:33.007322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-68a0055d-a723-4667-93cd-4422683eaa9e tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3" status: 200 len: 352 microversion: 2.1 time: 0.115555 May 27 09:36:33.023472 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 12/18] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:32 2022] GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:33.024533 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a8a1b640-cce5-4b96-8a90-f95e5afacfcc tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe33104280>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:33.051273 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-aef24e48-2519-46af-adef-d3e240a0730f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:33.051885 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-aef24e48-2519-46af-adef-d3e240a0730f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:33.068871 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a8a1b640-cce5-4b96-8a90-f95e5afacfcc tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7" status: 200 len: 287 microversion: 2.1 time: 0.048781 May 27 09:36:33.069483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 7/19] 10.222.0.48 () {58 vars in 1250 bytes} [Fri May 27 09:36:33 2022] GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:36:33.152202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-aef24e48-2519-46af-adef-d3e240a0730f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:33.168011 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-aef24e48-2519-46af-adef-d3e240a0730f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1215 microversion: 2.1 time: 0.120410 May 27 09:36:33.168704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 13/20] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:33 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1215 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:34.024107 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-72036eb2-7c43-4d70-900c-a10149897513 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Calling method '.version_select at 0x7fbe33121e50>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:34.086005 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-562ba16b-e17b-451e-8c5c-dcc1511a3cb5 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe3425c040>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:34.127586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-72036eb2-7c43-4d70-900c-a10149897513 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3" status: 200 len: 352 microversion: 2.1 time: 0.108671 May 27 09:36:34.128682 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 8/21] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:34 2022] GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 => generated 352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:34.151969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-562ba16b-e17b-451e-8c5c-dcc1511a3cb5 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7" status: 200 len: 287 microversion: 2.1 time: 0.073944 May 27 09:36:34.152623 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 14/22] 10.222.0.48 () {58 vars in 1250 bytes} [Fri May 27 09:36:34 2022] GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:34.185352 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e5eedce5-8d43-400c-8f8c-e42154c28e37 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:34.186341 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e5eedce5-8d43-400c-8f8c-e42154c28e37 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:34.194469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e5eedce5-8d43-400c-8f8c-e42154c28e37 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:34.195203 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e5eedce5-8d43-400c-8f8c-e42154c28e37 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:34.196194 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e5eedce5-8d43-400c-8f8c-e42154c28e37 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:34.196824 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e5eedce5-8d43-400c-8f8c-e42154c28e37 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:34.439221 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e5eedce5-8d43-400c-8f8c-e42154c28e37 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:34.466617 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e5eedce5-8d43-400c-8f8c-e42154c28e37 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1219 microversion: 2.1 time: 0.284819 May 27 09:36:34.470625 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 9/23] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:34 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1219 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:34.787937 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7ec0ca6c-9bd0-4f36-8df9-53a5fd8d7081 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Action: 'create', calling method: .version_select at 0x7fbe330a15e0>, body: {"keypair": {"name": "tempest-keypair-1559445978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNplcyjzJV+IZR8koqrlzoZS9sRq2FAKB+fPJA/7iwKFXEsdn2Lca1WQtgVXFGTEWobrT6+yJI3AHxAVb2E7O/pj4+knPwFGN2oUXUg78F/2tSJVgrRoyaDxNEocXEv4NQ=="}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:34.825134 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-7ec0ca6c-9bd0-4f36-8df9-53a5fd8d7081 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Getting quotas for project 836f9646586d4f409c181cdbfa24cb32. Resources: {'key_pairs'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:36:34.830232 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-7ec0ca6c-9bd0-4f36-8df9-53a5fd8d7081 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Getting quotas for user 8d52fe5018e2450dad79596fb1129c64 and project 836f9646586d4f409c181cdbfa24cb32. Resources: {'key_pairs'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:36:34.884650 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-dd49a204-73c3-40f7-9fea-2489ab69b329 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'create', calling method: .version_select at 0x7fbe342353a0>, body: {"keypair": {"name": "tempest-keypair-756230224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4+xW3gWTpVuW+e4rIifbIcZn/dUaWaO8eJK95PwjxSKWWjuV3c+5xwwMFmmXF39vWJ3WiG2wjCfL01nDF/tiLJiV6At0KkDTTI5mVJaieFlmaitLoWBcI6ltjNtrxzbg=="}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:34.956019 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-dd49a204-73c3-40f7-9fea-2489ab69b329 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Getting quotas for project 64c171ba5fcb489d911aeb8c5abf4bb2. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:36:34.964639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-dd49a204-73c3-40f7-9fea-2489ab69b329 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Getting quotas for user e5081aed86004f6c99a05c9fbf2a36b9 and project 64c171ba5fcb489d911aeb8c5abf4bb2. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:36:34.977233 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7ec0ca6c-9bd0-4f36-8df9-53a5fd8d7081 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.282458 May 27 09:36:34.978992 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 10/24] 10.222.0.48 () {62 vars in 1199 bytes} [Fri May 27 09:36:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 285 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 27 09:36:35.147656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5bc783d2-d8bb-4576-beab-716286d79713 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Calling method '.version_select at 0x7fbe33048ca0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:35.184964 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-dd49a204-73c3-40f7-9fea-2489ab69b329 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.638524 May 27 09:36:35.185940 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 15/25] 10.222.0.48 () {60 vars in 1158 bytes} [Fri May 27 09:36:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:35.214387 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e3bd8da2-ff25-48d3-90d5-7922cf0ec70c tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe3418cca0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:35.236636 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5bc783d2-d8bb-4576-beab-716286d79713 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3" status: 200 len: 352 microversion: 2.1 time: 0.099177 May 27 09:36:35.238407 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 11/26] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:35 2022] GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 => generated 352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:35.288554 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e3bd8da2-ff25-48d3-90d5-7922cf0ec70c tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7" status: 200 len: 287 microversion: 2.1 time: 0.084110 May 27 09:36:35.288554 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 16/27] 10.222.0.48 () {58 vars in 1250 bytes} [Fri May 27 09:36:35 2022] GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:35.490309 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4d432eea-b0fb-4432-b1d1-9dd2816d53b6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:35.491848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4d432eea-b0fb-4432-b1d1-9dd2816d53b6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:35.507212 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d432eea-b0fb-4432-b1d1-9dd2816d53b6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:35.508822 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d432eea-b0fb-4432-b1d1-9dd2816d53b6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:35.510823 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d432eea-b0fb-4432-b1d1-9dd2816d53b6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:35.512020 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d432eea-b0fb-4432-b1d1-9dd2816d53b6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:35.836805 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4d432eea-b0fb-4432-b1d1-9dd2816d53b6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:35.867050 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4d432eea-b0fb-4432-b1d1-9dd2816d53b6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1211 microversion: 2.1 time: 0.386072 May 27 09:36:35.872321 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 12/28] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:35 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1211 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:36.252547 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e82bca73-d80e-4c1d-8389-698b4dbbd3c1 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Calling method '.version_select at 0x7fbe3418cdc0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:36.297442 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e54ef073-abb7-4060-9f9d-58b2065ff053 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe33056dc0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:36.369322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e54ef073-abb7-4060-9f9d-58b2065ff053 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7" status: 200 len: 288 microversion: 2.1 time: 0.075812 May 27 09:36:36.371128 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 13/29] 10.222.0.48 () {58 vars in 1250 bytes} [Fri May 27 09:36:36 2022] GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 => generated 288 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:36:36.378951 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e82bca73-d80e-4c1d-8389-698b4dbbd3c1 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3" status: 200 len: 352 microversion: 2.1 time: 0.131300 May 27 09:36:36.379657 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 17/30] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:36 2022] GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 => generated 352 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:36.388184 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-15cd239d-10d8-4500-9491-879d628d82bd tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe33056310>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:36.655837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-15cd239d-10d8-4500-9491-879d628d82bd tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7" status: 202 len: 0 microversion: 2.1 time: 0.277691 May 27 09:36:36.657781 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 14/31] 10.222.0.48 () {58 vars in 1253 bytes} [Fri May 27 09:36:36 2022] DELETE /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:36:36.676141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e4224e40-e96d-4443-acb1-a297d510948c tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe3418c3a0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:36.781156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e4224e40-e96d-4443-acb1-a297d510948c tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7" status: 200 len: 287 microversion: 2.1 time: 0.117908 May 27 09:36:36.782526 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 18/32] 10.222.0.48 () {58 vars in 1250 bytes} [Fri May 27 09:36:36 2022] GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:36.835516 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-419c12f7-c312-44e1-80c9-b460b00c26eb tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe328051f0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:36.888622 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9cedfcab-d775-4cf6-87c6-4dd3942acdad tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:36.889919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9cedfcab-d775-4cf6-87c6-4dd3942acdad tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:36.909032 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9cedfcab-d775-4cf6-87c6-4dd3942acdad tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:36.911631 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9cedfcab-d775-4cf6-87c6-4dd3942acdad tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:36.912869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9cedfcab-d775-4cf6-87c6-4dd3942acdad tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:36.916097 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9cedfcab-d775-4cf6-87c6-4dd3942acdad tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:36.929418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-419c12f7-c312-44e1-80c9-b460b00c26eb tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/22b34c2d-0708-481d-b74f-8ed65059a07e" status: 200 len: 350 microversion: 2.1 time: 0.097977 May 27 09:36:36.931201 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 15/33] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:36 2022] GET /compute/v2.1/os-volumes/22b34c2d-0708-481d-b74f-8ed65059a07e => generated 350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:37.304702 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9cedfcab-d775-4cf6-87c6-4dd3942acdad tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:37.322152 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9cedfcab-d775-4cf6-87c6-4dd3942acdad tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1285 microversion: 2.1 time: 0.438386 May 27 09:36:37.322787 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 19/34] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:36 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1285 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:37.399333 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-234fdf9e-5226-47a3-b1e9-74dd9fdec8d8 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Calling method '.version_select at 0x7fbe32805280>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:37.796285 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-de764c36-692d-4104-81ad-74f4a0278e4d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe338e8280>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:37.966985 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-234fdf9e-5226-47a3-b1e9-74dd9fdec8d8 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] HTTP exception thrown: Volume 0564270d-a806-4d66-9ff1-6c8a82a312a3 could not be found. May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-234fdf9e-5226-47a3-b1e9-74dd9fdec8d8 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Request method failure captured: May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 HTTP/1.1 May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuYFCa2_lPUGx5fEINBMUlBa6dnTwhiZx-pmA5y9QlBodd2EmGEFyIGMglyIP6z6FC5NquW8CsGOPPUj8Paseh9tVUsS4ylKdDLbdKg-YL2TOqtRdzZwaOVIMesSs3wPjMJDgaS98oA_biCXfIdAP1mjG4MOWny6s6CHQCBPy_7aAs May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 1ae983f1ecde4623986967c0ef40c295 May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-VolumesGetTestJSON-1068094124 May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:36:37.972282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1ae983f1ecde4623986967c0ef40c295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1ae983f1ecde4623986967c0ef40c295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1ae983f1ecde4623986967c0ef40c295"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1ae983f1ecde4623986967c0ef40c295", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-VolumesGetTestJSON-1068094124 May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 1ae983f1ecde4623986967c0ef40c295 May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-VolumesGetTestJSON-1068094124 May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-VolumesGetTestJSON-1068094124-project May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 3575512e61e24d14b802cd58542ffade May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-VolumesGetTestJSON-1068094124-project May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Volume 0564270d-a806-4d66-9ff1-6c8a82a312a3 could not be found. May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '0564270d-a806-4d66-9ff1-6c8a82a312a3'} May 27 09:36:37.973390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0564270d-a806-4d66-9ff1-6c8a82a312a3 could not be found. (HTTP 404) (Request-ID: req-754d4d03-365c-4bd2-a5f2-29e29071f345) May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:37.974418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:36:37.975580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0564270d-a806-4d66-9ff1-6c8a82a312a3 could not be found. May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 09:36:37.984044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0564270d-a806-4d66-9ff1-6c8a82a312a3 could not be found. May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0564270d-a806-4d66-9ff1-6c8a82a312a3 could not be found. May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-234fdf9e-5226-47a3-b1e9-74dd9fdec8d8 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] Returning 404 to user: Volume 0564270d-a806-4d66-9ff1-6c8a82a312a3 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-234fdf9e-5226-47a3-b1e9-74dd9fdec8d8 tempest-VolumesGetTestJSON-1068094124 tempest-VolumesGetTestJSON-1068094124-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3" status: 404 len: 109 microversion: 2.1 time: 0.581777 May 27 09:36:37.985448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 16/35] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:37 2022] GET /compute/v2.1/os-volumes/0564270d-a806-4d66-9ff1-6c8a82a312a3 => generated 109 bytes in 583 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:36:38.049907 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-de764c36-692d-4104-81ad-74f4a0278e4d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] HTTP exception thrown: Snapshot c2b79ee1-107b-45f7-8478-3b66de531aa7 could not be found. May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-de764c36-692d-4104-81ad-74f4a0278e4d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Request method failure captured: May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 HTTP/1.1 May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuY69jf8rKN7FHeucZCJKSBITofnQIT_nMXG99OhULoPI0992hDXN_nQ2JtHnwEzIYBSisH2qMZjprhWidZcfVBnkkNwSbqPw0E236DqGlFVBtJHDAwUaZz2PS4f7LH3rc0bZVRdsEPZTvoVAxC3CBQte-Pxg-kQujHJ6j3vgcwmjg May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1598c6c82b11451fa6851486e117d6f4 May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:36:38.062846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1598c6c82b11451fa6851486e117d6f4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1598c6c82b11451fa6851486e117d6f4 May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-VolumesSnapshotsTestJSON-954037987-project May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 32ccc18481774bdcaf28dedf0edbd56c May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-VolumesSnapshotsTestJSON-954037987-project May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Snapshot c2b79ee1-107b-45f7-8478-3b66de531aa7 could not be found. May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': 'c2b79ee1-107b-45f7-8478-3b66de531aa7'} May 27 09:36:38.064158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c2b79ee1-107b-45f7-8478-3b66de531aa7 could not be found. (HTTP 404) (Request-ID: req-207ce9b5-dc44-4bdc-8512-7723b8b4aa7e) May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:38.064948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:36:38.065953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c2b79ee1-107b-45f7-8478-3b66de531aa7 could not be found. May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 27 09:36:38.066924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c2b79ee1-107b-45f7-8478-3b66de531aa7 could not be found. May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c2b79ee1-107b-45f7-8478-3b66de531aa7 could not be found. May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-de764c36-692d-4104-81ad-74f4a0278e4d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Returning 404 to user: Snapshot c2b79ee1-107b-45f7-8478-3b66de531aa7 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:38.067828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-de764c36-692d-4104-81ad-74f4a0278e4d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7" status: 404 len: 111 microversion: 2.1 time: 0.273067 May 27 09:36:38.070152 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 20/36] 10.222.0.48 () {58 vars in 1250 bytes} [Fri May 27 09:36:37 2022] GET /compute/v2.1/os-snapshots/c2b79ee1-107b-45f7-8478-3b66de531aa7 => generated 111 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:36:38.079752 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-31666e36-db40-4315-946c-13aa5fafbb96 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe34bdc310>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:38.351611 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4690337e-50df-41a1-815a-154fce76bac8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:38.353311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4690337e-50df-41a1-815a-154fce76bac8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:38.365091 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4690337e-50df-41a1-815a-154fce76bac8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:38.366358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4690337e-50df-41a1-815a-154fce76bac8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:38.367360 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4690337e-50df-41a1-815a-154fce76bac8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:38.367904 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4690337e-50df-41a1-815a-154fce76bac8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:38.460579 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-31666e36-db40-4315-946c-13aa5fafbb96 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14" status: 202 len: 0 microversion: 2.1 time: 0.382616 May 27 09:36:38.460579 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 17/37] 10.222.0.48 () {58 vars in 1247 bytes} [Fri May 27 09:36:38 2022] DELETE /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:36:38.470783 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3d9eadd3-933f-45e6-afd6-5b2faf64ce5f tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe328080d0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:38.532598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4690337e-50df-41a1-815a-154fce76bac8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:38.556033 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4690337e-50df-41a1-815a-154fce76bac8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1273 microversion: 2.1 time: 0.216090 May 27 09:36:38.556799 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 21/38] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:38 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1273 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:36:38.622474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3d9eadd3-933f-45e6-afd6-5b2faf64ce5f tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14" status: 200 len: 342 microversion: 2.1 time: 0.157890 May 27 09:36:38.623427 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 18/39] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:38 2022] GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 => generated 342 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:39.451483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4e723675-91eb-4e8f-8f97-4adfebadfecf tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe338b98b0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:39.570712 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4e723675-91eb-4e8f-8f97-4adfebadfecf tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/338441da-20c8-44b7-b1fc-25b4621c3a32" status: 200 len: 351 microversion: 2.1 time: 0.123652 May 27 09:36:39.571854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 22/40] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:39 2022] GET /compute/v2.1/os-volumes/338441da-20c8-44b7-b1fc-25b4621c3a32 => generated 351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:39.586008 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-179d9e28-8077-4033-a83c-6a252a6bf123 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:39.587337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-179d9e28-8077-4033-a83c-6a252a6bf123 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:39.588744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-513a17cc-df3e-4007-b276-ce5087af06e4 tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe3386cf70>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:39.621939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-179d9e28-8077-4033-a83c-6a252a6bf123 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:39.621939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-179d9e28-8077-4033-a83c-6a252a6bf123 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:39.621939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-179d9e28-8077-4033-a83c-6a252a6bf123 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:39.621939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-179d9e28-8077-4033-a83c-6a252a6bf123 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:39.742058 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:39.806459 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-513a17cc-df3e-4007-b276-ce5087af06e4 tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.224518 May 27 09:36:39.808869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 23/41] 10.222.0.48 () {58 vars in 1133 bytes} [Fri May 27 09:36:39 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:39.842541 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9541dced-9709-452a-b26b-1f75257f2179 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe33876280>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:40.006637 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9541dced-9709-452a-b26b-1f75257f2179 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14" status: 200 len: 342 microversion: 2.1 time: 0.195170 May 27 09:36:40.008474 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 24/42] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:39 2022] GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 => generated 342 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:40.020460 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1b613a03-6103-4487-aba9-47f8199843ed tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe338e8a60>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:40.144881 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1b613a03-6103-4487-aba9-47f8199843ed tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.134571 May 27 09:36:40.145464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 25/43] 10.222.0.48 () {58 vars in 1148 bytes} [Fri May 27 09:36:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:40.160434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3bc1b3ca-5f80-4af4-bbf3-0da0ba6177e5 tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe3386c3a0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:40.334719 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3bc1b3ca-5f80-4af4-bbf3-0da0ba6177e5 tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.178916 May 27 09:36:40.335825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 26/44] 10.222.0.48 () {58 vars in 1133 bytes} [Fri May 27 09:36:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:40.347859 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b6552e02-dd9b-4c25-b6e3-8f85fb6b180d tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe33942e50>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:40.450107 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b6552e02-dd9b-4c25-b6e3-8f85fb6b180d tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.105429 May 27 09:36:40.450107 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 27/45] 10.222.0.48 () {58 vars in 1166 bytes} [Fri May 27 09:36:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:36:40.465070 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-179d9e28-8077-4033-a83c-6a252a6bf123 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:40.465376 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-894a7d56-c2d7-4005-abe2-f4b00a4170f3 tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe338b9a60>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:40.507154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-179d9e28-8077-4033-a83c-6a252a6bf123 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.926721 May 27 09:36:40.508022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 19/46] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:39 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:40.608348 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-894a7d56-c2d7-4005-abe2-f4b00a4170f3 tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.146952 May 27 09:36:40.609505 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 28/47] 10.222.0.48 () {58 vars in 1169 bytes} [Fri May 27 09:36:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:40.633517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8b9b2c1d-a890-40b4-8d30-6fb04370181b tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe327e9f70>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:40.937319 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8b9b2c1d-a890-40b4-8d30-6fb04370181b tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.311412 May 27 09:36:40.952805 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 20/48] 10.222.0.48 () {58 vars in 1154 bytes} [Fri May 27 09:36:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:40.958410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e8d04741-38ee-4d04-9039-731ab510bb8a tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe3386c0d0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:41.021714 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-46d08356-5cfc-4ad0-ba55-9b850cb7497f tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe327fa700>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:41.327696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e8d04741-38ee-4d04-9039-731ab510bb8a tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.310520 May 27 09:36:41.327696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 29/49] 10.222.0.48 () {58 vars in 1187 bytes} [Fri May 27 09:36:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:41.328324 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-46d08356-5cfc-4ad0-ba55-9b850cb7497f tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14" status: 200 len: 342 microversion: 2.1 time: 0.248134 May 27 09:36:41.328324 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 21/50] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:41 2022] GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 => generated 342 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:41.329680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0407737e-6161-4285-906a-96993f7b1fab tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] Calling method '.version_select at 0x7fbe327faca0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:41.338599 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2031443392", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ed46cb4-c2ad-455c-9533-303118efbcc7"}], "security_groups": [{"name": "tempest-securitygroup--668001647"}], "key_name": "tempest-keypair-756230224", "user_data": "}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:41.548355 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0407737e-6161-4285-906a-96993f7b1fab tempest-VolumesTestJSON-157218255 tempest-VolumesTestJSON-157218255-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.173775 May 27 09:36:41.548355 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 22/51] 10.222.0.48 () {58 vars in 1154 bytes} [Fri May 27 09:36:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:41.549874 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.network.neutron [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] validate_networks() for [('9ed46cb4-c2ad-455c-9533-303118efbcc7', None, None, None, None, None)] {{(pid=124829) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:36:41.550994 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d3073563-57cf-4543-9da5-dde56dbd7683 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:41.550994 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d3073563-57cf-4543-9da5-dde56dbd7683 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:41.550994 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d3073563-57cf-4543-9da5-dde56dbd7683 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:41.550994 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d3073563-57cf-4543-9da5-dde56dbd7683 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:41.551554 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d3073563-57cf-4543-9da5-dde56dbd7683 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:41.551554 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d3073563-57cf-4543-9da5-dde56dbd7683 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:41.740427 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d3073563-57cf-4543-9da5-dde56dbd7683 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:41.749415 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d3073563-57cf-4543-9da5-dde56dbd7683 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.226910 May 27 09:36:41.750056 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 23/52] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:41 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:42.324124 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-af8813e2-633b-440c-86a6-78e71d2ba573 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe327e9280>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:42.432419 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-af8813e2-633b-440c-86a6-78e71d2ba573 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14" status: 200 len: 342 microversion: 2.1 time: 0.112688 May 27 09:36:42.433618 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 24/53] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:42 2022] GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 => generated 342 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:42.611891 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1267516166", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96b3e239-6dc9-4aed-81bd-731741d21afd"}], "security_groups": [{"name": "tempest-securitygroup--1457556392"}], "key_name": "tempest-keypair-1559445978", "user_data": "}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:42.854269 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] validate_networks() for [('96b3e239-6dc9-4aed-81bd-731741d21afd', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:36:43.213205 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Flavor limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:36:43.214759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Image limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:36:43.215477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Flavor pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:36:43.216066 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Image pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:36:43.216701 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:36:43.233735 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:43.239208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:43.247219 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:43.248397 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:43.312598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Getting quotas for project 64c171ba5fcb489d911aeb8c5abf4bb2. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:36:43.319118 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Getting quotas for user e5081aed86004f6c99a05c9fbf2a36b9 and project 64c171ba5fcb489d911aeb8c5abf4bb2. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:36:43.338325 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Going to run 1 instances... {{(pid=124829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:36:43.341372 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:36:43.535375 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:36:43.535998 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:36:43.536799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:36:43.537239 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:36:43.537663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:36:43.552862 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:43.553583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:43.555200 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:43.556103 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:43.581226 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Getting quotas for project 836f9646586d4f409c181cdbfa24cb32. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:36:43.587091 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Getting quotas for user 8d52fe5018e2450dad79596fb1129c64 and project 836f9646586d4f409c181cdbfa24cb32. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:36:43.603052 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:36:43.605535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:36:43.619271 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a56fe2be-5446-479a-a93a-ff90f258af7b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.298310 May 27 09:36:43.620290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 30/54] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:36:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 2300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:36:43.635666 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4c1f86a3-ee01-4c0b-ad94-f2f8760d733b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:43.638033 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4c1f86a3-ee01-4c0b-ad94-f2f8760d733b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:43.689223 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4c1f86a3-ee01-4c0b-ad94-f2f8760d733b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:43.691931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4c1f86a3-ee01-4c0b-ad94-f2f8760d733b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:43.693752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4c1f86a3-ee01-4c0b-ad94-f2f8760d733b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:43.694712 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4c1f86a3-ee01-4c0b-ad94-f2f8760d733b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:43.783947 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-213efba6-2112-4f9b-b42e-f63954223704 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.176727 May 27 09:36:43.785284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 25/55] 10.222.0.48 () {62 vars in 1187 bytes} [Fri May 27 09:36:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1179 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 09:36:44.194313 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4c1f86a3-ee01-4c0b-ad94-f2f8760d733b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:44.212589 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4c1f86a3-ee01-4c0b-ad94-f2f8760d733b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.589869 May 27 09:36:44.213719 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 31/56] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:43 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:44.225193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-835ef17c-b291-4631-b2fc-9886e7a1d795 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe337ee9d0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:44.345514 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-835ef17c-b291-4631-b2fc-9886e7a1d795 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] HTTP exception thrown: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-835ef17c-b291-4631-b2fc-9886e7a1d795 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Request method failure captured: May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 HTTP/1.1 May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuY69jf8rKN7FHeucZCJKSBITofnQIT_nMXG99OhULoPI0992hDXN_nQ2JtHnwEzIYBSisH2qMZjprhWidZcfVBnkkNwSbqPw0E236DqGlFVBtJHDAwUaZz2PS4f7LH3rc0bZVRdsEPZTvoVAxC3CBQte-Pxg-kQujHJ6j3vgcwmjg May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1598c6c82b11451fa6851486e117d6f4 May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:36:44.348660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1598c6c82b11451fa6851486e117d6f4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1598c6c82b11451fa6851486e117d6f4 May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-VolumesSnapshotsTestJSON-954037987-project May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 32ccc18481774bdcaf28dedf0edbd56c May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-VolumesSnapshotsTestJSON-954037987-project May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '119619e1-7748-4d48-a67d-58a333e28d14'} May 27 09:36:44.351073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. (HTTP 404) (Request-ID: req-5bbecfa2-f23e-4817-be0c-db785730ed7a) May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.353301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:36:44.381217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 09:36:44.383087 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-835ef17c-b291-4631-b2fc-9886e7a1d795 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Returning 404 to user: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-835ef17c-b291-4631-b2fc-9886e7a1d795 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14" status: 404 len: 109 microversion: 2.1 time: 0.135949 May 27 09:36:44.385003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 32/57] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:44 2022] GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:36:44.388367 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-bbd135bb-8c0a-44f8-bb9f-083f30580ce3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:44.400817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-bbd135bb-8c0a-44f8-bb9f-083f30580ce3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:44.621347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b4c0f2fa-961b-4e54-a600-2b6b757aadb9 tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Action: 'create', calling method: .version_select at 0x7fbe327faa60>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1682699825", "metadata": {"Type": "work"}}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b4c0f2fa-961b-4e54-a600-2b6b757aadb9 tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Request method failure captured: May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 122 May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuq9UnG48nkL8BMk5nwdiMEl_KboVr6c2M1eDdH0pxt6JHAQ-BUUUqfukUacUFDF_uUtGzYiu7ae1nDZfZwGvngwTcYLsb7aTlYS79llL6tNO5kyv8hcoGcwcui55ZT4cE-UdI5iDgXTg_qCRkm7kKmYfjT8oi4bLvx33zd6uQ76PI May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:36:44.636271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9554d406b5f6411597602150f5c4377b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9554d406b5f6411597602150f5c4377b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 2f305fc5265249899699d26aad4ae633 May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1682699825", "metadata": {"Type": "work"}}} May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: May 27 09:36:44.637450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1682699825', 'metadata': {'Type': 'work'}}}} May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise error May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi '#$%' May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:44.638313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 09:36:44.639421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 09:36:44.640384 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 27 09:36:44.640384 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.641668 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b4c0f2fa-961b-4e54-a600-2b6b757aadb9 tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:44.643049 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b4c0f2fa-961b-4e54-a600-2b6b757aadb9 tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.856241 May 27 09:36:44.648525 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 26/58] 10.222.0.48 () {60 vars in 1155 bytes} [Fri May 27 09:36:43 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 862 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 09:36:44.656356 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9f4126ee-6d45-4056-86f1-31564a763433 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:44.657963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9f4126ee-6d45-4056-86f1-31564a763433 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:44.766228 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-bbd135bb-8c0a-44f8-bb9f-083f30580ce3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:44.775323 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-bbd135bb-8c0a-44f8-bb9f-083f30580ce3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1237 microversion: 2.1 time: 0.419967 May 27 09:36:44.775908 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 33/59] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:44 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1237 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:44.784873 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9f4126ee-6d45-4056-86f1-31564a763433 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:44.788395 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9478183d-92d9-491e-ac28-c0fa04df7fe5 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe337eeca0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:44.798209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9f4126ee-6d45-4056-86f1-31564a763433 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:44.802423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9f4126ee-6d45-4056-86f1-31564a763433 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:44.807537 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9f4126ee-6d45-4056-86f1-31564a763433 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1282 microversion: 2.20 time: 0.155066 May 27 09:36:44.808364 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 27/60] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:44 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1282 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:36:44.820832 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-68109920-43bf-4f80-bf70-56b58d98028e tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Action: 'create', calling method: .version_select at 0x7fbe32805dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-869160748", "metadata": {"Type": "work"}}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-68109920-43bf-4f80-bf70-56b58d98028e tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Request method failure captured: May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 119 May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuq9UnG48nkL8BMk5nwdiMEl_KboVr6c2M1eDdH0pxt6JHAQ-BUUUqfukUacUFDF_uUtGzYiu7ae1nDZfZwGvngwTcYLsb7aTlYS79llL6tNO5kyv8hcoGcwcui55ZT4cE-UdI5iDgXTg_qCRkm7kKmYfjT8oi4bLvx33zd6uQ76PI May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:36:44.824535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9554d406b5f6411597602150f5c4377b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9554d406b5f6411597602150f5c4377b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 2f305fc5265249899699d26aad4ae633 May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-869160748", "metadata": {"Type": "work"}}} May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: May 27 09:36:44.825637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-869160748', 'metadata': {'Type': 'work'}}}} May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise error May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi '0' May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:44.826345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 09:36:44.827411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 09:36:44.828790 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 27 09:36:44.828790 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.828790 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-68109920-43bf-4f80-bf70-56b58d98028e tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:44.829607 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-68109920-43bf-4f80-bf70-56b58d98028e tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018763 May 27 09:36:44.830533 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 28/61] 10.222.0.48 () {60 vars in 1155 bytes} [Fri May 27 09:36:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 09:36:44.848251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0df9563b-b213-46d0-a8b1-d4dcd0c1c14e tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Action: 'create', calling method: .version_select at 0x7fbe3278baf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1252568716", "metadata": {"Type": "work"}}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0df9563b-b213-46d0-a8b1-d4dcd0c1c14e tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Request method failure captured: May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 119 May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuq9UnG48nkL8BMk5nwdiMEl_KboVr6c2M1eDdH0pxt6JHAQ-BUUUqfukUacUFDF_uUtGzYiu7ae1nDZfZwGvngwTcYLsb7aTlYS79llL6tNO5kyv8hcoGcwcui55ZT4cE-UdI5iDgXTg_qCRkm7kKmYfjT8oi4bLvx33zd6uQ76PI May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:36:44.851006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9554d406b5f6411597602150f5c4377b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9554d406b5f6411597602150f5c4377b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 2f305fc5265249899699d26aad4ae633 May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1252568716", "metadata": {"Type": "work"}}} May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: May 27 09:36:44.852416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1252568716', 'metadata': {'Type': 'work'}}}} May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise error May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi On instance['volume']: May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi '' May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:44.853422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 27 09:36:44.854780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 27 09:36:44.856006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 27 09:36:44.856006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.858176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0df9563b-b213-46d0-a8b1-d4dcd0c1c14e tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:44.860443 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0df9563b-b213-46d0-a8b1-d4dcd0c1c14e tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023164 May 27 09:36:44.861045 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 29/62] 10.222.0.48 () {60 vars in 1155 bytes} [Fri May 27 09:36:44 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 09:36:44.885821 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-9478183d-92d9-491e-ac28-c0fa04df7fe5 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] HTTP exception thrown: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:44.890710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-00726469-74db-4128-8ce2-832075a1598a tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Calling method '.version_select at 0x7fbe328055e0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9478183d-92d9-491e-ac28-c0fa04df7fe5 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Request method failure captured: May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 HTTP/1.1 May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuY69jf8rKN7FHeucZCJKSBITofnQIT_nMXG99OhULoPI0992hDXN_nQ2JtHnwEzIYBSisH2qMZjprhWidZcfVBnkkNwSbqPw0E236DqGlFVBtJHDAwUaZz2PS4f7LH3rc0bZVRdsEPZTvoVAxC3CBQte-Pxg-kQujHJ6j3vgcwmjg May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1598c6c82b11451fa6851486e117d6f4 May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:36:44.891721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1598c6c82b11451fa6851486e117d6f4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1598c6c82b11451fa6851486e117d6f4 May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-VolumesSnapshotsTestJSON-954037987-project May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 32ccc18481774bdcaf28dedf0edbd56c May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-VolumesSnapshotsTestJSON-954037987-project May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '119619e1-7748-4d48-a67d-58a333e28d14'} May 27 09:36:44.894030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. (HTTP 404) (Request-ID: req-36695143-13ef-45e2-b3ff-5ae318ce9341) May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.895416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:36:44.898736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 09:36:44.903214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9478183d-92d9-491e-ac28-c0fa04df7fe5 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Returning 404 to user: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9478183d-92d9-491e-ac28-c0fa04df7fe5 tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14" status: 404 len: 109 microversion: 2.1 time: 0.111847 May 27 09:36:44.906685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 34/63] 10.222.0.48 () {58 vars in 1247 bytes} [Fri May 27 09:36:44 2022] DELETE /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 => generated 109 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:36:44.925604 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-34a680b1-de0d-44e8-907c-dfd22320415d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Calling method '.version_select at 0x7fbe337fc820>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:44.957459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-00726469-74db-4128-8ce2-832075a1598a tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] HTTP exception thrown: Volume tempest-invalid-2073796892 could not be found. May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-00726469-74db-4128-8ce2-832075a1598a tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Request method failure captured: May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2073796892 HTTP/1.1 May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuq9UnG48nkL8BMk5nwdiMEl_KboVr6c2M1eDdH0pxt6JHAQ-BUUUqfukUacUFDF_uUtGzYiu7ae1nDZfZwGvngwTcYLsb7aTlYS79llL6tNO5kyv8hcoGcwcui55ZT4cE-UdI5iDgXTg_qCRkm7kKmYfjT8oi4bLvx33zd6uQ76PI May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:36:44.960702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9554d406b5f6411597602150f5c4377b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9554d406b5f6411597602150f5c4377b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 2f305fc5265249899699d26aad4ae633 May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Volume tempest-invalid-2073796892 could not be found. May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': 'tempest-invalid-2073796892'} May 27 09:36:44.961969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2073796892 could not be found. (HTTP 404) (Request-ID: req-11bffbb8-138c-4060-a220-a06d0bb5028d) May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.962885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:36:44.964504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2073796892 could not be found. May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:36:44.965912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2073796892 could not be found. May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2073796892 could not be found. May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-00726469-74db-4128-8ce2-832075a1598a tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Returning 404 to user: Volume tempest-invalid-2073796892 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-00726469-74db-4128-8ce2-832075a1598a tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2073796892" status: 404 len: 99 microversion: 2.1 time: 0.094784 May 27 09:36:44.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 30/64] 10.222.0.48 () {58 vars in 1217 bytes} [Fri May 27 09:36:44 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2073796892 => generated 99 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 27 09:36:44.998731 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-60da7c48-3073-494d-93cb-d1fa86f31e34 tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008626 May 27 09:36:45.001176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 31/65] 10.222.0.48 () {58 vars in 1139 bytes} [Fri May 27 09:36:44 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 27 09:36:45.011055 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-34a680b1-de0d-44e8-907c-dfd22320415d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] HTTP exception thrown: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-34a680b1-de0d-44e8-907c-dfd22320415d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Request method failure captured: May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 HTTP/1.1 May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuY69jf8rKN7FHeucZCJKSBITofnQIT_nMXG99OhULoPI0992hDXN_nQ2JtHnwEzIYBSisH2qMZjprhWidZcfVBnkkNwSbqPw0E236DqGlFVBtJHDAwUaZz2PS4f7LH3rc0bZVRdsEPZTvoVAxC3CBQte-Pxg-kQujHJ6j3vgcwmjg May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1598c6c82b11451fa6851486e117d6f4 May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:36:45.013145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1598c6c82b11451fa6851486e117d6f4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1598c6c82b11451fa6851486e117d6f4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1598c6c82b11451fa6851486e117d6f4 May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-954037987 May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-VolumesSnapshotsTestJSON-954037987-project May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 32ccc18481774bdcaf28dedf0edbd56c May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-VolumesSnapshotsTestJSON-954037987-project May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '119619e1-7748-4d48-a67d-58a333e28d14'} May 27 09:36:45.014483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. (HTTP 404) (Request-ID: req-12169579-bebf-4ca9-8cc8-c3bb034141f8) May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:45.015316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:36:45.016324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 09:36:45.017231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-34a680b1-de0d-44e8-907c-dfd22320415d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] Returning 404 to user: Volume 119619e1-7748-4d48-a67d-58a333e28d14 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:45.018141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-34a680b1-de0d-44e8-907c-dfd22320415d tempest-VolumesSnapshotsTestJSON-954037987 tempest-VolumesSnapshotsTestJSON-954037987-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14" status: 404 len: 109 microversion: 2.1 time: 0.111079 May 27 09:36:45.019473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 35/66] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:44 2022] GET /compute/v2.1/os-volumes/119619e1-7748-4d48-a67d-58a333e28d14 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:36:45.036129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1b67c3b3-0ac2-464a-b31a-696b50984542 tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017077 May 27 09:36:45.039534 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 32/67] 10.222.0.48 () {58 vars in 1136 bytes} [Fri May 27 09:36:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 27 09:36:45.054766 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-52c06f1a-7547-4fa4-a2b2-b8c416e92ebc tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Calling method '.version_select at 0x7fbe337ee040>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-52c06f1a-7547-4fa4-a2b2-b8c416e92ebc tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] HTTP exception thrown: Volume dcb907df-cb3d-4c0d-a4ef-d39805d678c5 could not be found. May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-52c06f1a-7547-4fa4-a2b2-b8c416e92ebc tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Request method failure captured: May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/os-volumes/dcb907df-cb3d-4c0d-a4ef-d39805d678c5 HTTP/1.1 May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuq9UnG48nkL8BMk5nwdiMEl_KboVr6c2M1eDdH0pxt6JHAQ-BUUUqfukUacUFDF_uUtGzYiu7ae1nDZfZwGvngwTcYLsb7aTlYS79llL6tNO5kyv8hcoGcwcui55ZT4cE-UdI5iDgXTg_qCRkm7kKmYfjT8oi4bLvx33zd6uQ76PI May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:36:45.142149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9554d406b5f6411597602150f5c4377b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9554d406b5f6411597602150f5c4377b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-VolumesNegativeTest-1000520465 May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 2f305fc5265249899699d26aad4ae633 May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Volume dcb907df-cb3d-4c0d-a4ef-d39805d678c5 could not be found. May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': 'dcb907df-cb3d-4c0d-a4ef-d39805d678c5'} May 27 09:36:45.143897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dcb907df-cb3d-4c0d-a4ef-d39805d678c5 could not be found. (HTTP 404) (Request-ID: req-d0f19ca3-5ec9-48ae-9348-06cd5eb1d288) May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:45.145042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 27 09:36:45.146410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dcb907df-cb3d-4c0d-a4ef-d39805d678c5 could not be found. May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 27 09:36:45.147832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dcb907df-cb3d-4c0d-a4ef-d39805d678c5 could not be found. May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dcb907df-cb3d-4c0d-a4ef-d39805d678c5 could not be found. May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:36:45.149697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-52c06f1a-7547-4fa4-a2b2-b8c416e92ebc tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Returning 404 to user: Volume dcb907df-cb3d-4c0d-a4ef-d39805d678c5 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:45.168244 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-52c06f1a-7547-4fa4-a2b2-b8c416e92ebc tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/dcb907df-cb3d-4c0d-a4ef-d39805d678c5" status: 404 len: 109 microversion: 2.1 time: 0.092811 May 27 09:36:45.171025 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 36/68] 10.222.0.48 () {58 vars in 1247 bytes} [Fri May 27 09:36:45 2022] DELETE /compute/v2.1/os-volumes/dcb907df-cb3d-4c0d-a4ef-d39805d678c5 => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:36:45.183321 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-43ccc1e1-89dd-428e-b294-4f2ff648d68b tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Calling method '.version_select at 0x7fbe3278baf0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:45.245687 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-fcaab20e-5d22-4893-80e1-f7476de98dae tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:45.245687 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-fcaab20e-5d22-4893-80e1-f7476de98dae tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:45.250867 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-43ccc1e1-89dd-428e-b294-4f2ff648d68b tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] HTTP exception thrown: Volume e6dae562-feaf-4687-8150-7a18fc0270c2 could not be found. May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-43ccc1e1-89dd-428e-b294-4f2ff648d68b tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Request method failure captured: May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/os-volumes/e6dae562-feaf-4687-8150-7a18fc0270c2 HTTP/1.1 May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuq9UnG48nkL8BMk5nwdiMEl_KboVr6c2M1eDdH0pxt6JHAQ-BUUUqfukUacUFDF_uUtGzYiu7ae1nDZfZwGvngwTcYLsb7aTlYS79llL6tNO5kyv8hcoGcwcui55ZT4cE-UdI5iDgXTg_qCRkm7kKmYfjT8oi4bLvx33zd6uQ76PI May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:36:45.254663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9554d406b5f6411597602150f5c4377b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9554d406b5f6411597602150f5c4377b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9554d406b5f6411597602150f5c4377b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-VolumesNegativeTest-1000520465 May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 9554d406b5f6411597602150f5c4377b May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-VolumesNegativeTest-1000520465 May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 2f305fc5265249899699d26aad4ae633 May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-VolumesNegativeTest-1000520465-project May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Volume e6dae562-feaf-4687-8150-7a18fc0270c2 could not be found. May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': 'e6dae562-feaf-4687-8150-7a18fc0270c2'} May 27 09:36:45.256072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e6dae562-feaf-4687-8150-7a18fc0270c2 could not be found. (HTTP 404) (Request-ID: req-73ca1b76-2a74-42d0-aff1-9be31e2864d5) May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:45.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi item = cinderclient( May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 27 09:36:45.259716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e6dae562-feaf-4687-8150-7a18fc0270c2 could not be found. May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 27 09:36:45.260859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e6dae562-feaf-4687-8150-7a18fc0270c2 could not be found. May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e6dae562-feaf-4687-8150-7a18fc0270c2 could not be found. May 27 09:36:45.264920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:36:45.274537 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-43ccc1e1-89dd-428e-b294-4f2ff648d68b tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] Returning 404 to user: Volume e6dae562-feaf-4687-8150-7a18fc0270c2 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:36:45.274537 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-43ccc1e1-89dd-428e-b294-4f2ff648d68b tempest-VolumesNegativeTest-1000520465 tempest-VolumesNegativeTest-1000520465-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e6dae562-feaf-4687-8150-7a18fc0270c2" status: 404 len: 109 microversion: 2.1 time: 0.097114 May 27 09:36:45.277636 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 33/69] 10.222.0.48 () {58 vars in 1244 bytes} [Fri May 27 09:36:45 2022] GET /compute/v2.1/os-volumes/e6dae562-feaf-4687-8150-7a18fc0270c2 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:36:45.294959 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fcaab20e-5d22-4893-80e1-f7476de98dae tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:45.296271 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fcaab20e-5d22-4893-80e1-f7476de98dae tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:45.299544 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fcaab20e-5d22-4893-80e1-f7476de98dae tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:45.315195 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fcaab20e-5d22-4893-80e1-f7476de98dae tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:45.804611 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fcaab20e-5d22-4893-80e1-f7476de98dae tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:45.806549 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-efe9b9f3-fdf3-4857-9a19-719bc5577dd7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:45.813060 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-efe9b9f3-fdf3-4857-9a19-719bc5577dd7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:45.841524 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-fcaab20e-5d22-4893-80e1-f7476de98dae tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.603677 May 27 09:36:45.844997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 37/70] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:45 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:45.867333 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-cf2a409d-a098-4e5d-960e-cb7e1c50f575 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:45.868237 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-cf2a409d-a098-4e5d-960e-cb7e1c50f575 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:46.026923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cf2a409d-a098-4e5d-960e-cb7e1c50f575 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:46.050294 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cf2a409d-a098-4e5d-960e-cb7e1c50f575 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:46.057939 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cf2a409d-a098-4e5d-960e-cb7e1c50f575 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:46.057939 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-cf2a409d-a098-4e5d-960e-cb7e1c50f575 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1282 microversion: 2.20 time: 0.199285 May 27 09:36:46.058920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-efe9b9f3-fdf3-4857-9a19-719bc5577dd7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:46.059524 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 38/71] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:45 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1282 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:36:46.098273 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-efe9b9f3-fdf3-4857-9a19-719bc5577dd7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1237 microversion: 2.1 time: 0.304449 May 27 09:36:46.099269 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 34/72] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:45 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1237 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:36:46.867651 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-981b341e-a4eb-4420-bf30-07e970c1af27 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:46.868387 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-981b341e-a4eb-4420-bf30-07e970c1af27 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:46.883703 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-981b341e-a4eb-4420-bf30-07e970c1af27 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:46.884172 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-981b341e-a4eb-4420-bf30-07e970c1af27 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:46.895642 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-981b341e-a4eb-4420-bf30-07e970c1af27 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:46.896159 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-981b341e-a4eb-4420-bf30-07e970c1af27 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:47.098488 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4362dc08-27c7-43da-9972-9b1d329a60a5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:47.126600 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4362dc08-27c7-43da-9972-9b1d329a60a5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:47.315408 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4362dc08-27c7-43da-9972-9b1d329a60a5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:47.331334 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4362dc08-27c7-43da-9972-9b1d329a60a5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:47.339514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4362dc08-27c7-43da-9972-9b1d329a60a5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:47.341455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4362dc08-27c7-43da-9972-9b1d329a60a5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1282 microversion: 2.20 time: 0.254237 May 27 09:36:47.345243 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 35/73] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:47 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:36:47.362117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-54e57eaf-2b68-44c0-bab2-6926f98c4ec5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:47.364543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-54e57eaf-2b68-44c0-bab2-6926f98c4ec5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:47.387603 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-54e57eaf-2b68-44c0-bab2-6926f98c4ec5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:47.390292 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-54e57eaf-2b68-44c0-bab2-6926f98c4ec5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:47.392708 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-54e57eaf-2b68-44c0-bab2-6926f98c4ec5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:47.394113 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-54e57eaf-2b68-44c0-bab2-6926f98c4ec5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:47.695937 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-54e57eaf-2b68-44c0-bab2-6926f98c4ec5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:47.732195 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-54e57eaf-2b68-44c0-bab2-6926f98c4ec5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1241 microversion: 2.1 time: 0.382448 May 27 09:36:47.736145 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 36/74] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:47 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1241 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:47.969381 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-981b341e-a4eb-4420-bf30-07e970c1af27 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:47.983613 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-981b341e-a4eb-4420-bf30-07e970c1af27 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 1.124320 May 27 09:36:47.988626 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 39/75] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:46 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:48.366490 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-cdb4756a-642f-40c0-9efd-7e94ce3c0f78 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:48.367142 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-cdb4756a-642f-40c0-9efd-7e94ce3c0f78 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:48.385789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cdb4756a-642f-40c0-9efd-7e94ce3c0f78 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:48.392358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cdb4756a-642f-40c0-9efd-7e94ce3c0f78 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:48.393908 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cdb4756a-642f-40c0-9efd-7e94ce3c0f78 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:48.401095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cdb4756a-642f-40c0-9efd-7e94ce3c0f78 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:48.474070 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-4cd9f2d0-2566-47a5-86ef-10481287d73c req-7a37ab01-398c-4c64-b1a1-4bec4f3bda98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00001e41-165d-4dc4-823a-b8cc67f00243", "tag": "b09333ea-b11f-48e1-af2d-cbbe7877fdae"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:48.544451 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-4cd9f2d0-2566-47a5-86ef-10481287d73c req-7a37ab01-398c-4c64-b1a1-4bec4f3bda98 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:48.545156 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-4cd9f2d0-2566-47a5-86ef-10481287d73c req-7a37ab01-398c-4c64-b1a1-4bec4f3bda98 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:48.684029 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-4cd9f2d0-2566-47a5-86ef-10481287d73c req-7a37ab01-398c-4c64-b1a1-4bec4f3bda98 service nova] Creating event network-changed:b09333ea-b11f-48e1-af2d-cbbe7877fdae for instance 00001e41-165d-4dc4-823a-b8cc67f00243 on hv-cinder-82549 May 27 09:36:48.690804 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-4cd9f2d0-2566-47a5-86ef-10481287d73c req-7a37ab01-398c-4c64-b1a1-4bec4f3bda98 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 09:36:48.693226 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d0414a0-617a-4f02-b0e3-010f905a3b01 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:48.709409 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d0414a0-617a-4f02-b0e3-010f905a3b01 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:48.710962 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d0414a0-617a-4f02-b0e3-010f905a3b01 None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:48.713643 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d0414a0-617a-4f02-b0e3-010f905a3b01 None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:48.760831 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.compute.rpcapi [None req-4d0414a0-617a-4f02-b0e3-010f905a3b01 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 09:36:48.771634 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d0414a0-617a-4f02-b0e3-010f905a3b01 None None] Releasing lock "compute-rpcapi-router" {{(pid=124828) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 09:36:48.825165 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4d0414a0-617a-4f02-b0e3-010f905a3b01 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.082794 May 27 09:36:48.827380 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 37/76] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:36:48.831983 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cdb4756a-642f-40c0-9efd-7e94ce3c0f78 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:48.857928 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cdb4756a-642f-40c0-9efd-7e94ce3c0f78 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:48.859659 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e9c9e5b8-9e6d-400f-b6cc-c86ba182ed1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:48.866106 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e9c9e5b8-9e6d-400f-b6cc-c86ba182ed1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:48.869102 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cdb4756a-642f-40c0-9efd-7e94ce3c0f78 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:48.877020 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-cdb4756a-642f-40c0-9efd-7e94ce3c0f78 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1278 microversion: 2.20 time: 0.513765 May 27 09:36:48.879002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 40/77] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:48 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1278 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:36:48.909226 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e9c9e5b8-9e6d-400f-b6cc-c86ba182ed1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:48.910594 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e9c9e5b8-9e6d-400f-b6cc-c86ba182ed1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:48.913595 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e9c9e5b8-9e6d-400f-b6cc-c86ba182ed1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:48.914664 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e9c9e5b8-9e6d-400f-b6cc-c86ba182ed1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:49.023997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f4a85d74-7029-4746-844c-3ee68f6c1620 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:49.023997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f4a85d74-7029-4746-844c-3ee68f6c1620 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:49.063907 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f4a85d74-7029-4746-844c-3ee68f6c1620 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:49.064671 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f4a85d74-7029-4746-844c-3ee68f6c1620 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:49.066094 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f4a85d74-7029-4746-844c-3ee68f6c1620 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:49.066883 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f4a85d74-7029-4746-844c-3ee68f6c1620 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:49.119212 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e9c9e5b8-9e6d-400f-b6cc-c86ba182ed1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:49.158050 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e9c9e5b8-9e6d-400f-b6cc-c86ba182ed1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1289 microversion: 2.1 time: 0.322538 May 27 09:36:49.164434 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 38/78] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:48 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1289 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:49.486597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f4a85d74-7029-4746-844c-3ee68f6c1620 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:49.515774 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f4a85d74-7029-4746-844c-3ee68f6c1620 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.500672 May 27 09:36:49.517699 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 41/79] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:49 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:36:49.914497 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-05c76368-1476-478b-9cb5-1b9ce75f0800 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:49.915798 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-05c76368-1476-478b-9cb5-1b9ce75f0800 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:49.926993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05c76368-1476-478b-9cb5-1b9ce75f0800 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:49.930163 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05c76368-1476-478b-9cb5-1b9ce75f0800 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:49.932049 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05c76368-1476-478b-9cb5-1b9ce75f0800 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:49.932555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05c76368-1476-478b-9cb5-1b9ce75f0800 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:50.083425 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-05c76368-1476-478b-9cb5-1b9ce75f0800 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:50.132410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-05c76368-1476-478b-9cb5-1b9ce75f0800 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:50.154844 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-05c76368-1476-478b-9cb5-1b9ce75f0800 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:50.161119 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-05c76368-1476-478b-9cb5-1b9ce75f0800 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1334 microversion: 2.20 time: 0.251757 May 27 09:36:50.199943 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 39/80] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:49 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1334 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:36:50.202058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d281637e-85c5-4605-bb20-9739b00113ae tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:50.203318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d281637e-85c5-4605-bb20-9739b00113ae tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:50.277792 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d281637e-85c5-4605-bb20-9739b00113ae tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:50.284268 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d281637e-85c5-4605-bb20-9739b00113ae tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:50.302843 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d281637e-85c5-4605-bb20-9739b00113ae tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:50.302843 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d281637e-85c5-4605-bb20-9739b00113ae tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:50.546129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ca3702d9-85fb-468c-8230-7123263a96dd tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:50.546129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ca3702d9-85fb-468c-8230-7123263a96dd tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:50.559546 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca3702d9-85fb-468c-8230-7123263a96dd tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:50.563591 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca3702d9-85fb-468c-8230-7123263a96dd tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:50.564654 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca3702d9-85fb-468c-8230-7123263a96dd tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:50.567329 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca3702d9-85fb-468c-8230-7123263a96dd tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:50.830911 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d281637e-85c5-4605-bb20-9739b00113ae tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:50.848745 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d281637e-85c5-4605-bb20-9739b00113ae tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1297 microversion: 2.1 time: 0.661768 May 27 09:36:50.858255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 42/81] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:50 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1297 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:51.095727 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ca3702d9-85fb-468c-8230-7123263a96dd tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:51.113906 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ca3702d9-85fb-468c-8230-7123263a96dd tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.573025 May 27 09:36:51.114879 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 40/82] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:50 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:51.235188 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b7678a1d-d2e3-4735-beb0-0387578dbc3c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:51.240500 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b7678a1d-d2e3-4735-beb0-0387578dbc3c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:51.248621 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7678a1d-d2e3-4735-beb0-0387578dbc3c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:51.249152 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7678a1d-d2e3-4735-beb0-0387578dbc3c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:51.251143 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7678a1d-d2e3-4735-beb0-0387578dbc3c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:51.253711 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7678a1d-d2e3-4735-beb0-0387578dbc3c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:51.518708 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b7678a1d-d2e3-4735-beb0-0387578dbc3c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:51.542172 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b7678a1d-d2e3-4735-beb0-0387578dbc3c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:51.544342 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b7678a1d-d2e3-4735-beb0-0387578dbc3c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:51.546148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b7678a1d-d2e3-4735-beb0-0387578dbc3c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1352 microversion: 2.20 time: 0.320855 May 27 09:36:51.547189 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 43/83] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:51 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1352 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:36:51.878750 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9384728b-439e-42e5-af80-53a6ec531237 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:51.879703 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9384728b-439e-42e5-af80-53a6ec531237 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:51.899937 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9384728b-439e-42e5-af80-53a6ec531237 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:51.904470 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9384728b-439e-42e5-af80-53a6ec531237 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:51.906273 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9384728b-439e-42e5-af80-53a6ec531237 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:51.907867 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9384728b-439e-42e5-af80-53a6ec531237 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:52.120499 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9384728b-439e-42e5-af80-53a6ec531237 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:52.145175 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e6e8706e-5001-4621-9e21-e37d6aec0fde tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:52.146509 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e6e8706e-5001-4621-9e21-e37d6aec0fde tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:52.154715 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9384728b-439e-42e5-af80-53a6ec531237 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1295 microversion: 2.1 time: 0.284101 May 27 09:36:52.172847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:51 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1295 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:52.183380 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e6e8706e-5001-4621-9e21-e37d6aec0fde tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:52.186358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e6e8706e-5001-4621-9e21-e37d6aec0fde tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:52.194675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e6e8706e-5001-4621-9e21-e37d6aec0fde tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:52.196016 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e6e8706e-5001-4621-9e21-e37d6aec0fde tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:52.565895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-32839907-28b3-4501-8546-a3472397803f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:52.566182 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-32839907-28b3-4501-8546-a3472397803f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:52.580366 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32839907-28b3-4501-8546-a3472397803f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:52.583717 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32839907-28b3-4501-8546-a3472397803f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:52.589461 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32839907-28b3-4501-8546-a3472397803f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:52.589461 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32839907-28b3-4501-8546-a3472397803f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:52.919114 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e6e8706e-5001-4621-9e21-e37d6aec0fde tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:52.937369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e6e8706e-5001-4621-9e21-e37d6aec0fde tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.797977 May 27 09:36:52.941038 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 44/85] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:52 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:52.942043 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-32839907-28b3-4501-8546-a3472397803f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:52.952702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-32839907-28b3-4501-8546-a3472397803f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:52.967916 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-32839907-28b3-4501-8546-a3472397803f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:52.969460 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-32839907-28b3-4501-8546-a3472397803f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1340 microversion: 2.20 time: 0.408256 May 27 09:36:52.974025 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 42/86] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:52 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1340 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:36:53.188169 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c0e9d211-951c-4fc4-aea9-a534e4b18371 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:53.213024 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c0e9d211-951c-4fc4-aea9-a534e4b18371 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:53.265659 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c0e9d211-951c-4fc4-aea9-a534e4b18371 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:53.269083 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c0e9d211-951c-4fc4-aea9-a534e4b18371 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:53.276085 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c0e9d211-951c-4fc4-aea9-a534e4b18371 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:53.281908 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c0e9d211-951c-4fc4-aea9-a534e4b18371 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:53.309136 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:53.976549 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b61810ab-5cfb-4ac3-b7cb-d6da257ee409 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:53.978323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b61810ab-5cfb-4ac3-b7cb-d6da257ee409 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:54.026779 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b61810ab-5cfb-4ac3-b7cb-d6da257ee409 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:54.028787 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b61810ab-5cfb-4ac3-b7cb-d6da257ee409 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:54.040963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b61810ab-5cfb-4ac3-b7cb-d6da257ee409 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:54.047164 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b61810ab-5cfb-4ac3-b7cb-d6da257ee409 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:54.827145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c0e9d211-951c-4fc4-aea9-a534e4b18371 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:54.863531 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c0e9d211-951c-4fc4-aea9-a534e4b18371 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 1.683066 May 27 09:36:54.887435 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 45/87] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:53 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 1705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:54.910562 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d22bb623-e626-4c64-a656-f3c989c0be2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:54.913163 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d22bb623-e626-4c64-a656-f3c989c0be2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:54.926636 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:54.954336 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d22bb623-e626-4c64-a656-f3c989c0be2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:54.955413 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d22bb623-e626-4c64-a656-f3c989c0be2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:54.957604 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d22bb623-e626-4c64-a656-f3c989c0be2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:54.960680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d22bb623-e626-4c64-a656-f3c989c0be2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:55.291678 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b61810ab-5cfb-4ac3-b7cb-d6da257ee409 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:55.295814 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=73 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:55.313391 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b61810ab-5cfb-4ac3-b7cb-d6da257ee409 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 1.342283 May 27 09:36:55.314851 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 43/88] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:53 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:36:55.695486 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d22bb623-e626-4c64-a656-f3c989c0be2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:55.721673 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d22bb623-e626-4c64-a656-f3c989c0be2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:55.732074 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d22bb623-e626-4c64-a656-f3c989c0be2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:55.735362 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d22bb623-e626-4c64-a656-f3c989c0be2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.842677 May 27 09:36:55.755103 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 46/89] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:54 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:36:55.897464 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f22297d5-8200-4caa-ad16-e7bc60ee2ba5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:55.898874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f22297d5-8200-4caa-ad16-e7bc60ee2ba5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:55.900594 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:55.912316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f22297d5-8200-4caa-ad16-e7bc60ee2ba5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:55.914755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f22297d5-8200-4caa-ad16-e7bc60ee2ba5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:55.918826 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f22297d5-8200-4caa-ad16-e7bc60ee2ba5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:55.919473 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f22297d5-8200-4caa-ad16-e7bc60ee2ba5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:56.347700 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f6fe9032-1d52-4694-b3d1-a0541d336d29 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:56.349918 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f6fe9032-1d52-4694-b3d1-a0541d336d29 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:56.353732 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=18 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:56.372088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f22297d5-8200-4caa-ad16-e7bc60ee2ba5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:56.413953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f6fe9032-1d52-4694-b3d1-a0541d336d29 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:56.414783 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f6fe9032-1d52-4694-b3d1-a0541d336d29 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:56.420008 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f6fe9032-1d52-4694-b3d1-a0541d336d29 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:56.422790 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f6fe9032-1d52-4694-b3d1-a0541d336d29 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:56.429155 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f22297d5-8200-4caa-ad16-e7bc60ee2ba5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.537110 May 27 09:36:56.431239 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 44/90] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:55 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:36:56.772653 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-80e7996c-d2bf-4995-afe3-3e4c21381fce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:56.773769 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-80e7996c-d2bf-4995-afe3-3e4c21381fce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:56.804912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-80e7996c-d2bf-4995-afe3-3e4c21381fce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:56.805672 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-80e7996c-d2bf-4995-afe3-3e4c21381fce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:56.806536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-80e7996c-d2bf-4995-afe3-3e4c21381fce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:56.816524 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-80e7996c-d2bf-4995-afe3-3e4c21381fce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:57.153218 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f6fe9032-1d52-4694-b3d1-a0541d336d29 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:57.165051 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-80e7996c-d2bf-4995-afe3-3e4c21381fce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:57.173502 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f6fe9032-1d52-4694-b3d1-a0541d336d29 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.841519 May 27 09:36:57.186238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 47/91] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:56 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:57.187898 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-80e7996c-d2bf-4995-afe3-3e4c21381fce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:57.187898 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-80e7996c-d2bf-4995-afe3-3e4c21381fce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:57.210778 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-80e7996c-d2bf-4995-afe3-3e4c21381fce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.445995 May 27 09:36:57.236728 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 45/92] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:56 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:36:57.461960 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b54e422f-4566-499f-bc98-32cb5b3c3dea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:57.462928 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b54e422f-4566-499f-bc98-32cb5b3c3dea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:57.470349 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b54e422f-4566-499f-bc98-32cb5b3c3dea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:57.470915 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b54e422f-4566-499f-bc98-32cb5b3c3dea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:57.472148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b54e422f-4566-499f-bc98-32cb5b3c3dea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:57.472148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b54e422f-4566-499f-bc98-32cb5b3c3dea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:57.494444 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-02673e5e-dcc8-43fc-85f9-e2fcd81dad1e req-328547c8-e7e1-4271-9c92-e49c99f5fc05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5ab4e3-6570-4604-b7fb-7592f7bb0d41", "tag": "374cd9b1-daa3-43bc-a1a9-b6bb36c1e8d5"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:57.514969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=24 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:57.517253 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-02673e5e-dcc8-43fc-85f9-e2fcd81dad1e req-328547c8-e7e1-4271-9c92-e49c99f5fc05 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:57.517854 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-02673e5e-dcc8-43fc-85f9-e2fcd81dad1e req-328547c8-e7e1-4271-9c92-e49c99f5fc05 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:57.561447 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-02673e5e-dcc8-43fc-85f9-e2fcd81dad1e req-328547c8-e7e1-4271-9c92-e49c99f5fc05 service nova] Creating event network-changed:374cd9b1-daa3-43bc-a1a9-b6bb36c1e8d5 for instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 on hv-cinder-82549 May 27 09:36:57.575924 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-02673e5e-dcc8-43fc-85f9-e2fcd81dad1e req-328547c8-e7e1-4271-9c92-e49c99f5fc05 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085702 May 27 09:36:57.580867 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 46/93] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:57.835839 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b54e422f-4566-499f-bc98-32cb5b3c3dea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:57.863906 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b54e422f-4566-499f-bc98-32cb5b3c3dea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.405351 May 27 09:36:57.866918 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 48/94] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:57 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:36:58.206710 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ca6617c6-0af4-46cf-87e9-62b5bf8aa152 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:58.207775 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ca6617c6-0af4-46cf-87e9-62b5bf8aa152 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:58.235350 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ca6617c6-0af4-46cf-87e9-62b5bf8aa152 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:58.236110 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ca6617c6-0af4-46cf-87e9-62b5bf8aa152 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:58.237622 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ca6617c6-0af4-46cf-87e9-62b5bf8aa152 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:58.238965 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ca6617c6-0af4-46cf-87e9-62b5bf8aa152 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:58.448683 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-319837c7-0f16-43bc-b846-161fd1cd97d2 req-03fa7955-1a72-4082-aab9-dae138b71005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f38432-87c8-46fe-b6fe-4795162677ca", "tag": "791d9d86-9101-48e0-92fa-96a2b245c1d6"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:36:58.458447 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-319837c7-0f16-43bc-b846-161fd1cd97d2 req-03fa7955-1a72-4082-aab9-dae138b71005 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:58.460337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-319837c7-0f16-43bc-b846-161fd1cd97d2 req-03fa7955-1a72-4082-aab9-dae138b71005 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:58.471921 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-319837c7-0f16-43bc-b846-161fd1cd97d2 req-03fa7955-1a72-4082-aab9-dae138b71005 service nova] Creating event network-changed:791d9d86-9101-48e0-92fa-96a2b245c1d6 for instance 68f38432-87c8-46fe-b6fe-4795162677ca on hv-cinder-82549 May 27 09:36:58.478602 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-319837c7-0f16-43bc-b846-161fd1cd97d2 req-03fa7955-1a72-4082-aab9-dae138b71005 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.402502 May 27 09:36:58.479221 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 47/95] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:36:58.485415 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-93a6164a-4ca3-4a26-9cb3-25feaaa3af94 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:58.486080 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-93a6164a-4ca3-4a26-9cb3-25feaaa3af94 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:58.495323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-93a6164a-4ca3-4a26-9cb3-25feaaa3af94 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:58.495323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-93a6164a-4ca3-4a26-9cb3-25feaaa3af94 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:58.495323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-93a6164a-4ca3-4a26-9cb3-25feaaa3af94 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:58.496427 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-93a6164a-4ca3-4a26-9cb3-25feaaa3af94 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:58.498019 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ca6617c6-0af4-46cf-87e9-62b5bf8aa152 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:58.509276 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ca6617c6-0af4-46cf-87e9-62b5bf8aa152 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.310202 May 27 09:36:58.510520 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 49/96] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:58 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:58.747631 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=4 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:36:58.807481 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-93a6164a-4ca3-4a26-9cb3-25feaaa3af94 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:58.816522 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-93a6164a-4ca3-4a26-9cb3-25feaaa3af94 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:58.830614 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-93a6164a-4ca3-4a26-9cb3-25feaaa3af94 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:58.836959 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-93a6164a-4ca3-4a26-9cb3-25feaaa3af94 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.352171 May 27 09:36:58.838435 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 48/97] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:58 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:36:58.888149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8bfb682a-dd2c-4b37-a1d0-aad295fecce6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:58.889137 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8bfb682a-dd2c-4b37-a1d0-aad295fecce6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:58.912512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8bfb682a-dd2c-4b37-a1d0-aad295fecce6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:58.916045 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8bfb682a-dd2c-4b37-a1d0-aad295fecce6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:58.920991 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8bfb682a-dd2c-4b37-a1d0-aad295fecce6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:58.922410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8bfb682a-dd2c-4b37-a1d0-aad295fecce6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:59.232550 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8bfb682a-dd2c-4b37-a1d0-aad295fecce6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:59.254600 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8bfb682a-dd2c-4b37-a1d0-aad295fecce6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.373906 May 27 09:36:59.255654 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 50/98] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:58 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:59.530793 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d56e8464-513b-41a4-b5bd-05d8ebbf93b5 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:59.533587 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d56e8464-513b-41a4-b5bd-05d8ebbf93b5 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:59.549009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d56e8464-513b-41a4-b5bd-05d8ebbf93b5 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:59.549750 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d56e8464-513b-41a4-b5bd-05d8ebbf93b5 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:59.552285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d56e8464-513b-41a4-b5bd-05d8ebbf93b5 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:59.553311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d56e8464-513b-41a4-b5bd-05d8ebbf93b5 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:59.831350 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d56e8464-513b-41a4-b5bd-05d8ebbf93b5 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:36:59.849387 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d56e8464-513b-41a4-b5bd-05d8ebbf93b5 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.325179 May 27 09:36:59.850869 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:36:59 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:36:59.876750 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8c6a7c42-8503-4d3d-8e79-87338ce70419 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:36:59.878522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8c6a7c42-8503-4d3d-8e79-87338ce70419 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:36:59.887909 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8c6a7c42-8503-4d3d-8e79-87338ce70419 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:59.890770 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8c6a7c42-8503-4d3d-8e79-87338ce70419 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:59.890770 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8c6a7c42-8503-4d3d-8e79-87338ce70419 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:36:59.891049 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8c6a7c42-8503-4d3d-8e79-87338ce70419 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:36:59.897416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=100 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:00.073430 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8c6a7c42-8503-4d3d-8e79-87338ce70419 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:00.083768 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8c6a7c42-8503-4d3d-8e79-87338ce70419 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:00.085927 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8c6a7c42-8503-4d3d-8e79-87338ce70419 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:00.087404 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8c6a7c42-8503-4d3d-8e79-87338ce70419 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.217880 May 27 09:37:00.088192 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 51/100] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:36:59 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:00.273128 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1b0925f1-46d1-4fde-843c-a38a3e2257d0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:00.273870 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1b0925f1-46d1-4fde-843c-a38a3e2257d0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:00.281469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b0925f1-46d1-4fde-843c-a38a3e2257d0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:00.285082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b0925f1-46d1-4fde-843c-a38a3e2257d0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:00.285082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b0925f1-46d1-4fde-843c-a38a3e2257d0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:00.285082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b0925f1-46d1-4fde-843c-a38a3e2257d0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:00.632524 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1b0925f1-46d1-4fde-843c-a38a3e2257d0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:00.664815 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1b0925f1-46d1-4fde-843c-a38a3e2257d0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.396342 May 27 09:37:00.667276 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 50/101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:00 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:00.880742 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-16756e96-95f6-4290-9503-ff0efe3e272e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:00.882906 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-16756e96-95f6-4290-9503-ff0efe3e272e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:00.895358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-16756e96-95f6-4290-9503-ff0efe3e272e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:00.896142 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-16756e96-95f6-4290-9503-ff0efe3e272e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:00.897832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-16756e96-95f6-4290-9503-ff0efe3e272e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:00.898890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-16756e96-95f6-4290-9503-ff0efe3e272e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:01.125099 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-566a07cb-634f-4189-80bc-ab1d60241de1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:01.126435 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-566a07cb-634f-4189-80bc-ab1d60241de1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:01.137560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-566a07cb-634f-4189-80bc-ab1d60241de1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:01.138380 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-566a07cb-634f-4189-80bc-ab1d60241de1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:01.139853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-566a07cb-634f-4189-80bc-ab1d60241de1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:01.140631 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-566a07cb-634f-4189-80bc-ab1d60241de1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:01.203954 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-16756e96-95f6-4290-9503-ff0efe3e272e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:01.218111 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-16756e96-95f6-4290-9503-ff0efe3e272e tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.344852 May 27 09:37:01.219191 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 52/102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:00 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:01.372571 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-566a07cb-634f-4189-80bc-ab1d60241de1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:01.382452 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-566a07cb-634f-4189-80bc-ab1d60241de1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:01.384213 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-566a07cb-634f-4189-80bc-ab1d60241de1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:01.385453 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-566a07cb-634f-4189-80bc-ab1d60241de1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.268783 May 27 09:37:01.386137 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 51/103] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:01 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:01.694724 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-383d114a-c0e6-4e17-b0d1-d1504c7e964c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:01.695345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-383d114a-c0e6-4e17-b0d1-d1504c7e964c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:01.701845 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-383d114a-c0e6-4e17-b0d1-d1504c7e964c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:01.702294 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-383d114a-c0e6-4e17-b0d1-d1504c7e964c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:01.703108 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-383d114a-c0e6-4e17-b0d1-d1504c7e964c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:01.703538 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-383d114a-c0e6-4e17-b0d1-d1504c7e964c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:02.188571 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-383d114a-c0e6-4e17-b0d1-d1504c7e964c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:02.197455 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-383d114a-c0e6-4e17-b0d1-d1504c7e964c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.506796 May 27 09:37:02.198057 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 53/104] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:01 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:37:02.243733 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fcfe64f4-6d69-4cc9-9299-e0ccc7e18ec6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:02.244584 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fcfe64f4-6d69-4cc9-9299-e0ccc7e18ec6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:02.254718 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fcfe64f4-6d69-4cc9-9299-e0ccc7e18ec6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:02.255172 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fcfe64f4-6d69-4cc9-9299-e0ccc7e18ec6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:02.255975 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fcfe64f4-6d69-4cc9-9299-e0ccc7e18ec6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:02.256420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fcfe64f4-6d69-4cc9-9299-e0ccc7e18ec6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:02.405625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-50d4f792-d23b-4e80-b9ad-3bdbbefd85e8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:02.412947 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-50d4f792-d23b-4e80-b9ad-3bdbbefd85e8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:02.427312 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-50d4f792-d23b-4e80-b9ad-3bdbbefd85e8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:02.427312 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-50d4f792-d23b-4e80-b9ad-3bdbbefd85e8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:02.427959 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-50d4f792-d23b-4e80-b9ad-3bdbbefd85e8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:02.428556 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-50d4f792-d23b-4e80-b9ad-3bdbbefd85e8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:02.545236 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fcfe64f4-6d69-4cc9-9299-e0ccc7e18ec6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:02.564199 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fcfe64f4-6d69-4cc9-9299-e0ccc7e18ec6 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.322180 May 27 09:37:02.585699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 52/105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:02 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:02.663078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-50d4f792-d23b-4e80-b9ad-3bdbbefd85e8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:02.679257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-50d4f792-d23b-4e80-b9ad-3bdbbefd85e8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:02.681259 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-50d4f792-d23b-4e80-b9ad-3bdbbefd85e8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:02.682461 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-50d4f792-d23b-4e80-b9ad-3bdbbefd85e8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.281246 May 27 09:37:02.690157 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 54/106] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:02 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:03.232514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8fa9c216-b8f9-4d61-af79-c49f89b3b7e0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:03.234083 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8fa9c216-b8f9-4d61-af79-c49f89b3b7e0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:03.249452 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8fa9c216-b8f9-4d61-af79-c49f89b3b7e0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:03.252797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8fa9c216-b8f9-4d61-af79-c49f89b3b7e0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:03.252797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8fa9c216-b8f9-4d61-af79-c49f89b3b7e0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:03.252797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8fa9c216-b8f9-4d61-af79-c49f89b3b7e0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:03.531268 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8fa9c216-b8f9-4d61-af79-c49f89b3b7e0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:03.546188 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8fa9c216-b8f9-4d61-af79-c49f89b3b7e0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.322968 May 27 09:37:03.548037 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 53/107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:03 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:03.603165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d3bb505a-a634-4bfa-a341-745cbf3a9e3c tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:03.604424 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d3bb505a-a634-4bfa-a341-745cbf3a9e3c tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:03.614764 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d3bb505a-a634-4bfa-a341-745cbf3a9e3c tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:03.615293 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d3bb505a-a634-4bfa-a341-745cbf3a9e3c tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:03.616352 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d3bb505a-a634-4bfa-a341-745cbf3a9e3c tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:03.617058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d3bb505a-a634-4bfa-a341-745cbf3a9e3c tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:03.721241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8d8f1c7e-5bd9-4b2c-a7a9-8be912dd7aa2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:03.729281 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8d8f1c7e-5bd9-4b2c-a7a9-8be912dd7aa2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:03.742272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8d8f1c7e-5bd9-4b2c-a7a9-8be912dd7aa2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:03.743147 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8d8f1c7e-5bd9-4b2c-a7a9-8be912dd7aa2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:03.759099 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8d8f1c7e-5bd9-4b2c-a7a9-8be912dd7aa2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:03.766467 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8d8f1c7e-5bd9-4b2c-a7a9-8be912dd7aa2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:03.955408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d3bb505a-a634-4bfa-a341-745cbf3a9e3c tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:03.972505 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d3bb505a-a634-4bfa-a341-745cbf3a9e3c tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.381321 May 27 09:37:03.985436 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 55/108] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:03 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:04.094499 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8d8f1c7e-5bd9-4b2c-a7a9-8be912dd7aa2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:04.131750 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8d8f1c7e-5bd9-4b2c-a7a9-8be912dd7aa2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:04.133868 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8d8f1c7e-5bd9-4b2c-a7a9-8be912dd7aa2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:04.135998 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8d8f1c7e-5bd9-4b2c-a7a9-8be912dd7aa2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.423199 May 27 09:37:04.157100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 54/109] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:03 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:04.579719 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0c19e1d5-6c11-4630-b85d-11df78bc2080 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:04.580292 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0c19e1d5-6c11-4630-b85d-11df78bc2080 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:04.587173 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0c19e1d5-6c11-4630-b85d-11df78bc2080 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:04.587960 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0c19e1d5-6c11-4630-b85d-11df78bc2080 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:04.588766 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0c19e1d5-6c11-4630-b85d-11df78bc2080 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:04.589210 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0c19e1d5-6c11-4630-b85d-11df78bc2080 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:04.827246 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0c19e1d5-6c11-4630-b85d-11df78bc2080 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:04.840208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0c19e1d5-6c11-4630-b85d-11df78bc2080 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.267753 May 27 09:37:04.841886 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 56/110] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:04 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:05.001963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3226ea7d-00f4-47a2-a2c1-173f0f4502c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:05.004108 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3226ea7d-00f4-47a2-a2c1-173f0f4502c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:05.020305 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3226ea7d-00f4-47a2-a2c1-173f0f4502c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:05.021864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3226ea7d-00f4-47a2-a2c1-173f0f4502c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:05.024850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3226ea7d-00f4-47a2-a2c1-173f0f4502c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:05.026103 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3226ea7d-00f4-47a2-a2c1-173f0f4502c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:05.168840 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-20c90378-1f69-4b5d-ade9-bb2d61e9fdd2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:05.170676 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-20c90378-1f69-4b5d-ade9-bb2d61e9fdd2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:05.184721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-20c90378-1f69-4b5d-ade9-bb2d61e9fdd2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:05.185619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-20c90378-1f69-4b5d-ade9-bb2d61e9fdd2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:05.188114 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-20c90378-1f69-4b5d-ade9-bb2d61e9fdd2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:05.188809 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-20c90378-1f69-4b5d-ade9-bb2d61e9fdd2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:05.474746 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3226ea7d-00f4-47a2-a2c1-173f0f4502c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:05.494347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3226ea7d-00f4-47a2-a2c1-173f0f4502c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.501595 May 27 09:37:05.506182 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 55/111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:04 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:37:05.595646 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-20c90378-1f69-4b5d-ade9-bb2d61e9fdd2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:05.611326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-20c90378-1f69-4b5d-ade9-bb2d61e9fdd2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:05.613045 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-20c90378-1f69-4b5d-ade9-bb2d61e9fdd2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:05.614296 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-20c90378-1f69-4b5d-ade9-bb2d61e9fdd2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.450437 May 27 09:37:05.625486 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 57/112] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:05 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:05.876182 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6a9bcf42-d59c-48c6-8e9e-3dbb2d085d33 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:05.877331 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6a9bcf42-d59c-48c6-8e9e-3dbb2d085d33 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:05.909034 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a9bcf42-d59c-48c6-8e9e-3dbb2d085d33 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:05.909946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a9bcf42-d59c-48c6-8e9e-3dbb2d085d33 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:05.914870 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a9bcf42-d59c-48c6-8e9e-3dbb2d085d33 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:05.917368 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a9bcf42-d59c-48c6-8e9e-3dbb2d085d33 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:06.242148 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-ca15c816-cd13-460b-af20-ef81c01815ad req-457cf0a1-479d-4916-a0ac-df3d7676b533 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00001e41-165d-4dc4-823a-b8cc67f00243", "name": "network-vif-plugged", "status": "completed", "tag": "b09333ea-b11f-48e1-af2d-cbbe7877fdae"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:37:06.263574 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-ca15c816-cd13-460b-af20-ef81c01815ad req-457cf0a1-479d-4916-a0ac-df3d7676b533 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:06.265866 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-ca15c816-cd13-460b-af20-ef81c01815ad req-457cf0a1-479d-4916-a0ac-df3d7676b533 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:06.295907 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-ca15c816-cd13-460b-af20-ef81c01815ad req-457cf0a1-479d-4916-a0ac-df3d7676b533 service nova] Creating event network-vif-plugged:b09333ea-b11f-48e1-af2d-cbbe7877fdae for instance 00001e41-165d-4dc4-823a-b8cc67f00243 on hv-cinder-82549 May 27 09:37:06.312529 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-ca15c816-cd13-460b-af20-ef81c01815ad req-457cf0a1-479d-4916-a0ac-df3d7676b533 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.800139 May 27 09:37:06.321350 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 56/113] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:37:06.551558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f389f050-4c4b-4d94-bcef-e7a3ca8b8cda tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:06.552606 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f389f050-4c4b-4d94-bcef-e7a3ca8b8cda tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:06.560797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f389f050-4c4b-4d94-bcef-e7a3ca8b8cda tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:06.561580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f389f050-4c4b-4d94-bcef-e7a3ca8b8cda tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:06.563224 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f389f050-4c4b-4d94-bcef-e7a3ca8b8cda tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:06.563920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f389f050-4c4b-4d94-bcef-e7a3ca8b8cda tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:06.722273 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-6a9bcf42-d59c-48c6-8e9e-3dbb2d085d33 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:06.734946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6a9bcf42-d59c-48c6-8e9e-3dbb2d085d33 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.863445 May 27 09:37:06.746354 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 58/114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:05 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:06.753562 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c1d41702-3b11-42ce-8748-594ef054e90d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:06.755010 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c1d41702-3b11-42ce-8748-594ef054e90d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:06.762430 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c1d41702-3b11-42ce-8748-594ef054e90d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:06.763229 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c1d41702-3b11-42ce-8748-594ef054e90d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:06.766421 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c1d41702-3b11-42ce-8748-594ef054e90d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:06.766421 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c1d41702-3b11-42ce-8748-594ef054e90d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:06.878878 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f389f050-4c4b-4d94-bcef-e7a3ca8b8cda tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:06.897265 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f389f050-4c4b-4d94-bcef-e7a3ca8b8cda tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.350632 May 27 09:37:06.914022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 57/115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:06 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:37:07.248809 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c1d41702-3b11-42ce-8748-594ef054e90d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:07.264242 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c1d41702-3b11-42ce-8748-594ef054e90d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:07.267652 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c1d41702-3b11-42ce-8748-594ef054e90d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:07.269796 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c1d41702-3b11-42ce-8748-594ef054e90d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.521819 May 27 09:37:07.271031 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 59/116] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:06 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:07.767011 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9c61a755-0699-4b32-b442-8c304496a408 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:07.768332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9c61a755-0699-4b32-b442-8c304496a408 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:07.784557 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c61a755-0699-4b32-b442-8c304496a408 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:07.785809 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c61a755-0699-4b32-b442-8c304496a408 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:07.787768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c61a755-0699-4b32-b442-8c304496a408 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:07.788727 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c61a755-0699-4b32-b442-8c304496a408 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:07.926962 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d5690f67-1d2b-4dc1-9852-5888a5853f1f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:07.928094 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d5690f67-1d2b-4dc1-9852-5888a5853f1f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:07.938550 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d5690f67-1d2b-4dc1-9852-5888a5853f1f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:07.939253 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d5690f67-1d2b-4dc1-9852-5888a5853f1f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:07.940408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d5690f67-1d2b-4dc1-9852-5888a5853f1f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:07.941010 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d5690f67-1d2b-4dc1-9852-5888a5853f1f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:08.166813 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9c61a755-0699-4b32-b442-8c304496a408 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:08.178990 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9c61a755-0699-4b32-b442-8c304496a408 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.429126 May 27 09:37:08.180135 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 58/117] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:07 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:08.257106 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d5690f67-1d2b-4dc1-9852-5888a5853f1f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:08.267173 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d5690f67-1d2b-4dc1-9852-5888a5853f1f tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.344742 May 27 09:37:08.267780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 60/118] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:07 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:37:08.295228 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b9598bd8-ab08-421e-a094-9ce79c6bf1aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:08.296269 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b9598bd8-ab08-421e-a094-9ce79c6bf1aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:08.307234 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b9598bd8-ab08-421e-a094-9ce79c6bf1aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:08.307987 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b9598bd8-ab08-421e-a094-9ce79c6bf1aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:08.309297 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b9598bd8-ab08-421e-a094-9ce79c6bf1aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:08.310016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b9598bd8-ab08-421e-a094-9ce79c6bf1aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:08.504914 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b9598bd8-ab08-421e-a094-9ce79c6bf1aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:08.514250 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b9598bd8-ab08-421e-a094-9ce79c6bf1aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:08.516370 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b9598bd8-ab08-421e-a094-9ce79c6bf1aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:08.517526 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b9598bd8-ab08-421e-a094-9ce79c6bf1aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.229278 May 27 09:37:08.518093 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 59/119] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:08 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:09.204974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d542bf9e-281a-4187-80ac-1333babded77 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:09.206598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d542bf9e-281a-4187-80ac-1333babded77 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:09.220436 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d542bf9e-281a-4187-80ac-1333babded77 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:09.221617 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d542bf9e-281a-4187-80ac-1333babded77 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:09.223889 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d542bf9e-281a-4187-80ac-1333babded77 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:09.224946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d542bf9e-281a-4187-80ac-1333babded77 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:09.297836 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8b007aee-2a4e-40e7-9a43-04f9b569ff6a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:09.299980 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8b007aee-2a4e-40e7-9a43-04f9b569ff6a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:09.311101 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b007aee-2a4e-40e7-9a43-04f9b569ff6a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:09.312341 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b007aee-2a4e-40e7-9a43-04f9b569ff6a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:09.314468 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b007aee-2a4e-40e7-9a43-04f9b569ff6a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:09.315268 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b007aee-2a4e-40e7-9a43-04f9b569ff6a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:09.493919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d542bf9e-281a-4187-80ac-1333babded77 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:09.521431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d542bf9e-281a-4187-80ac-1333babded77 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.327673 May 27 09:37:09.545861 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 61/120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:09 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:09.558659 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-19ebe744-5d91-4531-9c38-499c14736be8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:09.559550 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-19ebe744-5d91-4531-9c38-499c14736be8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:09.577071 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19ebe744-5d91-4531-9c38-499c14736be8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:09.578461 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19ebe744-5d91-4531-9c38-499c14736be8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:09.579684 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19ebe744-5d91-4531-9c38-499c14736be8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:09.580390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19ebe744-5d91-4531-9c38-499c14736be8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:09.631031 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8b007aee-2a4e-40e7-9a43-04f9b569ff6a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:09.652413 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8b007aee-2a4e-40e7-9a43-04f9b569ff6a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.359555 May 27 09:37:09.654038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 60/121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:09 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:37:09.816782 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-19ebe744-5d91-4531-9c38-499c14736be8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:09.831581 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-19ebe744-5d91-4531-9c38-499c14736be8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:09.834422 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-19ebe744-5d91-4531-9c38-499c14736be8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:09.836816 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-19ebe744-5d91-4531-9c38-499c14736be8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.287688 May 27 09:37:09.837765 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 62/122] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:09 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:10.541800 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b2a1e5e1-302b-41cd-8bcd-d8427c6001f5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:10.542750 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b2a1e5e1-302b-41cd-8bcd-d8427c6001f5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:10.552143 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2a1e5e1-302b-41cd-8bcd-d8427c6001f5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:10.552592 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2a1e5e1-302b-41cd-8bcd-d8427c6001f5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:10.553381 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2a1e5e1-302b-41cd-8bcd-d8427c6001f5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:10.553847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2a1e5e1-302b-41cd-8bcd-d8427c6001f5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:10.691114 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2b476226-aed7-4965-9e80-ffe5c194847b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:10.691114 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2b476226-aed7-4965-9e80-ffe5c194847b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:10.700405 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2b476226-aed7-4965-9e80-ffe5c194847b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:10.701297 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2b476226-aed7-4965-9e80-ffe5c194847b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:10.703624 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2b476226-aed7-4965-9e80-ffe5c194847b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:10.704552 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2b476226-aed7-4965-9e80-ffe5c194847b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:10.791871 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b2a1e5e1-302b-41cd-8bcd-d8427c6001f5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:10.815615 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b2a1e5e1-302b-41cd-8bcd-d8427c6001f5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.274704 May 27 09:37:10.819475 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 61/123] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:10 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:10.870403 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-39dfb1ea-da62-4882-9599-0810709538c4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:10.872170 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-39dfb1ea-da62-4882-9599-0810709538c4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:10.886880 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-39dfb1ea-da62-4882-9599-0810709538c4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:10.888000 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-39dfb1ea-da62-4882-9599-0810709538c4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:10.889690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-39dfb1ea-da62-4882-9599-0810709538c4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:10.890845 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-39dfb1ea-da62-4882-9599-0810709538c4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:10.929457 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=100 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:10.965888 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2b476226-aed7-4965-9e80-ffe5c194847b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:11.003251 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2b476226-aed7-4965-9e80-ffe5c194847b tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.321657 May 27 09:37:11.026448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 63/124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:10 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:11.240493 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-39dfb1ea-da62-4882-9599-0810709538c4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:11.269722 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-39dfb1ea-da62-4882-9599-0810709538c4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:11.273031 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-39dfb1ea-da62-4882-9599-0810709538c4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:11.285952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-39dfb1ea-da62-4882-9599-0810709538c4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.422020 May 27 09:37:11.287117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 62/125] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:10 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:11.836262 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-33c58238-a87a-4418-b1d7-2b3e6d6f7e2e req-17848243-104d-4d4c-b241-8e28ddadab07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f38432-87c8-46fe-b6fe-4795162677ca", "name": "network-vif-plugged", "status": "completed", "tag": "791d9d86-9101-48e0-92fa-96a2b245c1d6"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:37:11.846376 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-72bfacd5-0ca2-4ea3-bb73-abca2c347b1d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:11.847592 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-72bfacd5-0ca2-4ea3-bb73-abca2c347b1d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:11.860722 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72bfacd5-0ca2-4ea3-bb73-abca2c347b1d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:11.861307 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72bfacd5-0ca2-4ea3-bb73-abca2c347b1d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:11.862485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72bfacd5-0ca2-4ea3-bb73-abca2c347b1d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:11.863241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72bfacd5-0ca2-4ea3-bb73-abca2c347b1d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:11.868228 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-33c58238-a87a-4418-b1d7-2b3e6d6f7e2e req-17848243-104d-4d4c-b241-8e28ddadab07 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:11.870308 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-33c58238-a87a-4418-b1d7-2b3e6d6f7e2e req-17848243-104d-4d4c-b241-8e28ddadab07 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:11.917651 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-33c58238-a87a-4418-b1d7-2b3e6d6f7e2e req-17848243-104d-4d4c-b241-8e28ddadab07 service nova] Creating event network-vif-plugged:791d9d86-9101-48e0-92fa-96a2b245c1d6 for instance 68f38432-87c8-46fe-b6fe-4795162677ca on hv-cinder-82549 May 27 09:37:11.919169 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-33c58238-a87a-4418-b1d7-2b3e6d6f7e2e req-17848243-104d-4d4c-b241-8e28ddadab07 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124829) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 27 09:37:11.921638 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a92ed5cd-f783-4919-a8da-22e413069fa9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:11.923019 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a92ed5cd-f783-4919-a8da-22e413069fa9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:11.924846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a92ed5cd-f783-4919-a8da-22e413069fa9 None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:11.925655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a92ed5cd-f783-4919-a8da-22e413069fa9 None None] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:11.947407 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.compute.rpcapi [None req-a92ed5cd-f783-4919-a8da-22e413069fa9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 27 09:37:11.949164 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a92ed5cd-f783-4919-a8da-22e413069fa9 None None] Releasing lock "compute-rpcapi-router" {{(pid=124829) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 27 09:37:11.979177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a92ed5cd-f783-4919-a8da-22e413069fa9 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160602 May 27 09:37:11.979986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 64/126] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:37:12.034300 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e333ba66-3ee8-408d-b408-5381299d7354 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:12.035319 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e333ba66-3ee8-408d-b408-5381299d7354 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:12.054529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e333ba66-3ee8-408d-b408-5381299d7354 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:12.055255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e333ba66-3ee8-408d-b408-5381299d7354 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:12.056065 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e333ba66-3ee8-408d-b408-5381299d7354 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:12.058607 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e333ba66-3ee8-408d-b408-5381299d7354 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:12.229005 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-72bfacd5-0ca2-4ea3-bb73-abca2c347b1d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:12.243558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-72bfacd5-0ca2-4ea3-bb73-abca2c347b1d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.405314 May 27 09:37:12.245043 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 63/127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:11 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:12.335774 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d9098834-646e-49e4-b7df-73bad640298f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:12.336965 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d9098834-646e-49e4-b7df-73bad640298f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:12.344995 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e333ba66-3ee8-408d-b408-5381299d7354 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:12.356467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e333ba66-3ee8-408d-b408-5381299d7354 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1315 microversion: 2.1 time: 0.327258 May 27 09:37:12.357199 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d9098834-646e-49e4-b7df-73bad640298f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:12.358186 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d9098834-646e-49e4-b7df-73bad640298f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:12.358535 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 65/128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:12 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:37:12.361149 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d9098834-646e-49e4-b7df-73bad640298f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:12.361944 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d9098834-646e-49e4-b7df-73bad640298f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:12.631355 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d9098834-646e-49e4-b7df-73bad640298f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:12.648284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d9098834-646e-49e4-b7df-73bad640298f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:12.650515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d9098834-646e-49e4-b7df-73bad640298f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:12.652232 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d9098834-646e-49e4-b7df-73bad640298f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.341698 May 27 09:37:12.663719 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 64/129] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:12 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:37:13.270208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-cb1b8a0c-6b5e-4298-af98-7332971ed7b2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:13.270208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-cb1b8a0c-6b5e-4298-af98-7332971ed7b2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:13.277426 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cb1b8a0c-6b5e-4298-af98-7332971ed7b2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:13.278245 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cb1b8a0c-6b5e-4298-af98-7332971ed7b2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:13.279505 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cb1b8a0c-6b5e-4298-af98-7332971ed7b2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:13.280222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cb1b8a0c-6b5e-4298-af98-7332971ed7b2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:13.396905 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fd81038e-da30-449f-bd8e-2c3eb7913065 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:13.399256 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fd81038e-da30-449f-bd8e-2c3eb7913065 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:13.414644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd81038e-da30-449f-bd8e-2c3eb7913065 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:13.415757 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd81038e-da30-449f-bd8e-2c3eb7913065 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:13.418067 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd81038e-da30-449f-bd8e-2c3eb7913065 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:13.419178 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd81038e-da30-449f-bd8e-2c3eb7913065 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:13.517704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cb1b8a0c-6b5e-4298-af98-7332971ed7b2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:13.529220 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-cb1b8a0c-6b5e-4298-af98-7332971ed7b2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.270782 May 27 09:37:13.531103 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 66/130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:13 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:13.698696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-01f49543-fc41-4299-80d5-94995e70ffb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:13.699991 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-01f49543-fc41-4299-80d5-94995e70ffb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:13.725164 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-01f49543-fc41-4299-80d5-94995e70ffb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:13.728813 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-01f49543-fc41-4299-80d5-94995e70ffb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:13.730753 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-01f49543-fc41-4299-80d5-94995e70ffb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:13.732499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-01f49543-fc41-4299-80d5-94995e70ffb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:13.753392 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fd81038e-da30-449f-bd8e-2c3eb7913065 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:13.775404 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fd81038e-da30-449f-bd8e-2c3eb7913065 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1502 microversion: 2.1 time: 0.387196 May 27 09:37:13.777627 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 65/131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:13 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1502 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:37:14.039102 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-7778338d-2f9b-4499-97d3-55f28b6568a9 req-b09cc32b-5fc1-47b5-9cf5-1ccea60c59c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5ab4e3-6570-4604-b7fb-7592f7bb0d41", "name": "network-vif-plugged", "status": "completed", "tag": "374cd9b1-daa3-43bc-a1a9-b6bb36c1e8d5"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:37:14.082269 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-01f49543-fc41-4299-80d5-94995e70ffb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:14.083939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-7778338d-2f9b-4499-97d3-55f28b6568a9 req-b09cc32b-5fc1-47b5-9cf5-1ccea60c59c1 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:14.085616 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-7778338d-2f9b-4499-97d3-55f28b6568a9 req-b09cc32b-5fc1-47b5-9cf5-1ccea60c59c1 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:14.110999 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-01f49543-fc41-4299-80d5-94995e70ffb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:14.120577 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-7778338d-2f9b-4499-97d3-55f28b6568a9 req-b09cc32b-5fc1-47b5-9cf5-1ccea60c59c1 service nova] Creating event network-vif-plugged:374cd9b1-daa3-43bc-a1a9-b6bb36c1e8d5 for instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 on hv-cinder-82549 May 27 09:37:14.121760 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-01f49543-fc41-4299-80d5-94995e70ffb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:14.124966 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-01f49543-fc41-4299-80d5-94995e70ffb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.449925 May 27 09:37:14.131895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 67/132] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:13 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:37:14.136011 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-7778338d-2f9b-4499-97d3-55f28b6568a9 req-b09cc32b-5fc1-47b5-9cf5-1ccea60c59c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113587 May 27 09:37:14.138689 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 66/133] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:37:14.576190 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-23f6b1b8-9d50-4f03-aac0-5c250603b72d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:14.579405 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-23f6b1b8-9d50-4f03-aac0-5c250603b72d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:14.601385 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23f6b1b8-9d50-4f03-aac0-5c250603b72d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:14.603898 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23f6b1b8-9d50-4f03-aac0-5c250603b72d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:14.605638 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23f6b1b8-9d50-4f03-aac0-5c250603b72d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:14.606079 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23f6b1b8-9d50-4f03-aac0-5c250603b72d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:14.626571 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=100 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:14.961095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-23f6b1b8-9d50-4f03-aac0-5c250603b72d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:14.984510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-23f6b1b8-9d50-4f03-aac0-5c250603b72d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.424270 May 27 09:37:14.984510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 68/134] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:14 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:15.166068 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e00f98ff-3f17-42a4-aacb-cbb9d24c384e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:15.173192 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e00f98ff-3f17-42a4-aacb-cbb9d24c384e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:15.202234 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e00f98ff-3f17-42a4-aacb-cbb9d24c384e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:15.202234 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e00f98ff-3f17-42a4-aacb-cbb9d24c384e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:15.202234 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e00f98ff-3f17-42a4-aacb-cbb9d24c384e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:15.202234 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e00f98ff-3f17-42a4-aacb-cbb9d24c384e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:15.851276 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e00f98ff-3f17-42a4-aacb-cbb9d24c384e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:15.870297 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e00f98ff-3f17-42a4-aacb-cbb9d24c384e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:15.873227 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e00f98ff-3f17-42a4-aacb-cbb9d24c384e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:15.875244 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e00f98ff-3f17-42a4-aacb-cbb9d24c384e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1408 microversion: 2.20 time: 0.716057 May 27 09:37:15.876038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 67/135] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:15 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1408 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:37:16.039569 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f99be09d-f4ab-4204-b0e5-9b83dae667bf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:16.041383 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f99be09d-f4ab-4204-b0e5-9b83dae667bf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:16.079593 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f99be09d-f4ab-4204-b0e5-9b83dae667bf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:16.080590 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f99be09d-f4ab-4204-b0e5-9b83dae667bf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:16.082490 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f99be09d-f4ab-4204-b0e5-9b83dae667bf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:16.083322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f99be09d-f4ab-4204-b0e5-9b83dae667bf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:16.347698 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f99be09d-f4ab-4204-b0e5-9b83dae667bf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:16.357643 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f99be09d-f4ab-4204-b0e5-9b83dae667bf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.352375 May 27 09:37:16.358159 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 69/136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:16 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:16.903587 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b0e1800a-b32a-4436-b4da-83c1886c7382 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:16.904288 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b0e1800a-b32a-4436-b4da-83c1886c7382 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:16.918024 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b0e1800a-b32a-4436-b4da-83c1886c7382 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:16.918633 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b0e1800a-b32a-4436-b4da-83c1886c7382 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:16.919894 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b0e1800a-b32a-4436-b4da-83c1886c7382 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:16.920618 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b0e1800a-b32a-4436-b4da-83c1886c7382 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:17.046023 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5e4f41a0-ec0c-41f7-8c77-37a96fdfd88a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3d83d98-367b-4a84-b492-44e930698573"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:37:17.048199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5e4f41a0-ec0c-41f7-8c77-37a96fdfd88a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:17.060838 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5e4f41a0-ec0c-41f7-8c77-37a96fdfd88a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:17.062512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5e4f41a0-ec0c-41f7-8c77-37a96fdfd88a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:17.064191 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5e4f41a0-ec0c-41f7-8c77-37a96fdfd88a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:17.065431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5e4f41a0-ec0c-41f7-8c77-37a96fdfd88a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:17.163410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b0e1800a-b32a-4436-b4da-83c1886c7382 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:17.184374 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b0e1800a-b32a-4436-b4da-83c1886c7382 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:17.189480 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b0e1800a-b32a-4436-b4da-83c1886c7382 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:17.192144 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b0e1800a-b32a-4436-b4da-83c1886c7382 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1599 microversion: 2.20 time: 0.293372 May 27 09:37:17.193504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 68/137] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:37:16 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1599 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:37:17.221047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-71c0827b-8170-4094-be4b-03e3f77fa644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:17.222361 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-71c0827b-8170-4094-be4b-03e3f77fa644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:17.234999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71c0827b-8170-4094-be4b-03e3f77fa644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:17.235762 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71c0827b-8170-4094-be4b-03e3f77fa644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:17.237480 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71c0827b-8170-4094-be4b-03e3f77fa644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:17.238318 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71c0827b-8170-4094-be4b-03e3f77fa644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:17.514480 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-71c0827b-8170-4094-be4b-03e3f77fa644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.304514 May 27 09:37:17.516586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 69/138] 10.222.0.48 () {60 vars in 1315 bytes} [Fri May 27 09:37:17 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-interface => generated 284 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:37:17.535432 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5435adaf-bdf6-4c6a-9824-0da42b530a06 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:17.538189 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5435adaf-bdf6-4c6a-9824-0da42b530a06 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:17.555154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5435adaf-bdf6-4c6a-9824-0da42b530a06 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:17.556554 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5435adaf-bdf6-4c6a-9824-0da42b530a06 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:17.558498 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5435adaf-bdf6-4c6a-9824-0da42b530a06 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:17.560998 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5435adaf-bdf6-4c6a-9824-0da42b530a06 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:18.057566 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-5435adaf-bdf6-4c6a-9824-0da42b530a06 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:18.100788 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5435adaf-bdf6-4c6a-9824-0da42b530a06 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1362 microversion: 2.1 time: 0.582380 May 27 09:37:18.114799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 70/139] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:17 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1362 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:18.935202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5e4f41a0-ec0c-41f7-8c77-37a96fdfd88a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "POST /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.893581 May 27 09:37:18.937752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 70/140] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:37:17 2022] POST /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243/os-volume_attachments => generated 194 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:37:19.149455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-12fba99f-8da2-45ef-bce4-c0e395173c9a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:19.152518 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-12fba99f-8da2-45ef-bce4-c0e395173c9a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:19.166191 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-12fba99f-8da2-45ef-bce4-c0e395173c9a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:19.167465 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-12fba99f-8da2-45ef-bce4-c0e395173c9a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:19.169364 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-12fba99f-8da2-45ef-bce4-c0e395173c9a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:19.170633 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-12fba99f-8da2-45ef-bce4-c0e395173c9a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:19.709122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-12fba99f-8da2-45ef-bce4-c0e395173c9a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:19.723780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-12fba99f-8da2-45ef-bce4-c0e395173c9a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1547 microversion: 2.1 time: 0.581414 May 27 09:37:19.725489 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 71/141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:19 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1547 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:19.749674 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-effe36d7-c959-4339-bef0-a001d6ef9816 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:19.751240 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-effe36d7-c959-4339-bef0-a001d6ef9816 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:19.768213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-effe36d7-c959-4339-bef0-a001d6ef9816 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:19.769306 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-effe36d7-c959-4339-bef0-a001d6ef9816 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:19.771227 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-effe36d7-c959-4339-bef0-a001d6ef9816 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:19.772190 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-effe36d7-c959-4339-bef0-a001d6ef9816 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:20.023983 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-effe36d7-c959-4339-bef0-a001d6ef9816 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.283370 May 27 09:37:20.027294 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 71/142] 10.222.0.48 () {58 vars in 1274 bytes} [Fri May 27 09:37:19 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/os-interface => generated 285 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:37:20.395961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-1cdee688-9171-4c00-b007-cab348000971 req-ea792346-457e-4c7d-96a2-cf572d38f090 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68f38432-87c8-46fe-b6fe-4795162677ca", "tag": "791d9d86-9101-48e0-92fa-96a2b245c1d6"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:37:20.419299 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-1cdee688-9171-4c00-b007-cab348000971 req-ea792346-457e-4c7d-96a2-cf572d38f090 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:20.421376 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-1cdee688-9171-4c00-b007-cab348000971 req-ea792346-457e-4c7d-96a2-cf572d38f090 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:20.452819 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-1cdee688-9171-4c00-b007-cab348000971 req-ea792346-457e-4c7d-96a2-cf572d38f090 service nova] Creating event network-changed:791d9d86-9101-48e0-92fa-96a2b245c1d6 for instance 68f38432-87c8-46fe-b6fe-4795162677ca on hv-cinder-82549 May 27 09:37:20.463846 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-1cdee688-9171-4c00-b007-cab348000971 req-ea792346-457e-4c7d-96a2-cf572d38f090 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077722 May 27 09:37:20.465371 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 72/143] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:37:24.135313 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:24.152528 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-f44719aa-cd4c-43d9-ad2e-f8b7d2398abb req-8f3b757e-2c0c-4961-984e-5868e61661c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b5ab4e3-6570-4604-b7fb-7592f7bb0d41", "tag": "374cd9b1-daa3-43bc-a1a9-b6bb36c1e8d5"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:37:24.183916 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-f44719aa-cd4c-43d9-ad2e-f8b7d2398abb req-8f3b757e-2c0c-4961-984e-5868e61661c2 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:24.184472 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-f44719aa-cd4c-43d9-ad2e-f8b7d2398abb req-8f3b757e-2c0c-4961-984e-5868e61661c2 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:24.219532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-f44719aa-cd4c-43d9-ad2e-f8b7d2398abb req-8f3b757e-2c0c-4961-984e-5868e61661c2 service nova] Creating event network-changed:374cd9b1-daa3-43bc-a1a9-b6bb36c1e8d5 for instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 on hv-cinder-82549 May 27 09:37:24.226058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-f44719aa-cd4c-43d9-ad2e-f8b7d2398abb req-8f3b757e-2c0c-4961-984e-5868e61661c2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092959 May 27 09:37:24.227412 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 72/144] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:37:29.420488 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-10b66ea6-aa44-4ad6-9bc1-5f74535f38c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:29.421913 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-10b66ea6-aa44-4ad6-9bc1-5f74535f38c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:29.423800 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=58 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:29.433243 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-10b66ea6-aa44-4ad6-9bc1-5f74535f38c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:29.433753 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-10b66ea6-aa44-4ad6-9bc1-5f74535f38c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:29.434771 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-10b66ea6-aa44-4ad6-9bc1-5f74535f38c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:29.435447 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-10b66ea6-aa44-4ad6-9bc1-5f74535f38c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:29.476530 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-10b66ea6-aa44-4ad6-9bc1-5f74535f38c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:37:29.880328 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-10b66ea6-aa44-4ad6-9bc1-5f74535f38c8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "DELETE /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 204 len: 0 microversion: 2.1 time: 0.463839 May 27 09:37:29.881800 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 73/145] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:37:29 2022] DELETE /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:37:29.896304 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e04b3cde-dcda-46ef-a037-f677b2dc82fa tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:29.897429 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e04b3cde-dcda-46ef-a037-f677b2dc82fa tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:29.900275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=54 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:29.910889 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e04b3cde-dcda-46ef-a037-f677b2dc82fa tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:29.912475 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e04b3cde-dcda-46ef-a037-f677b2dc82fa tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:29.914421 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e04b3cde-dcda-46ef-a037-f677b2dc82fa tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:29.915549 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e04b3cde-dcda-46ef-a037-f677b2dc82fa tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:30.354160 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e04b3cde-dcda-46ef-a037-f677b2dc82fa tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:30.367030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e04b3cde-dcda-46ef-a037-f677b2dc82fa tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1554 microversion: 2.1 time: 0.479524 May 27 09:37:30.367919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 73/146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:29 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1554 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:31.387039 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1b65d9f7-814c-46d8-9bbf-8c2a894daf00 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:31.387039 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1b65d9f7-814c-46d8-9bbf-8c2a894daf00 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:31.393540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b65d9f7-814c-46d8-9bbf-8c2a894daf00 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:31.393999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b65d9f7-814c-46d8-9bbf-8c2a894daf00 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:31.394817 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b65d9f7-814c-46d8-9bbf-8c2a894daf00 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:31.395254 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b65d9f7-814c-46d8-9bbf-8c2a894daf00 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:31.548005 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1b65d9f7-814c-46d8-9bbf-8c2a894daf00 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:31.557853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1b65d9f7-814c-46d8-9bbf-8c2a894daf00 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1554 microversion: 2.1 time: 0.176352 May 27 09:37:31.558604 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 74/147] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:31 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:32.577715 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7660f11f-c8bc-4d2d-8fdc-f3684b516053 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:32.578565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7660f11f-c8bc-4d2d-8fdc-f3684b516053 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:32.588025 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7660f11f-c8bc-4d2d-8fdc-f3684b516053 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:32.588926 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7660f11f-c8bc-4d2d-8fdc-f3684b516053 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:32.589653 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7660f11f-c8bc-4d2d-8fdc-f3684b516053 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:32.590357 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7660f11f-c8bc-4d2d-8fdc-f3684b516053 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:32.804948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7660f11f-c8bc-4d2d-8fdc-f3684b516053 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:32.814065 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7660f11f-c8bc-4d2d-8fdc-f3684b516053 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1554 microversion: 2.1 time: 0.241395 May 27 09:37:32.814777 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 74/148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:32 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:33.060507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-18e21a21-58be-41c7-8a58-0eb78ae7602c req-10c722af-c711-4c00-bd47-6849a5b7ad0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00001e41-165d-4dc4-823a-b8cc67f00243", "name": "network-vif-deleted", "tag": "b09333ea-b11f-48e1-af2d-cbbe7877fdae"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:37:33.076340 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-18e21a21-58be-41c7-8a58-0eb78ae7602c req-10c722af-c711-4c00-bd47-6849a5b7ad0f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:33.077687 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-18e21a21-58be-41c7-8a58-0eb78ae7602c req-10c722af-c711-4c00-bd47-6849a5b7ad0f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:33.099678 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-18e21a21-58be-41c7-8a58-0eb78ae7602c req-10c722af-c711-4c00-bd47-6849a5b7ad0f service nova] Creating event network-vif-deleted:b09333ea-b11f-48e1-af2d-cbbe7877fdae for instance 00001e41-165d-4dc4-823a-b8cc67f00243 on hv-cinder-82549 May 27 09:37:33.108858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-18e21a21-58be-41c7-8a58-0eb78ae7602c req-10c722af-c711-4c00-bd47-6849a5b7ad0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055564 May 27 09:37:33.110147 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 75/149] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:37:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:37:33.834336 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:33.835227 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:33.844262 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:33.845455 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:33.847284 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:33.847949 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:33.899830 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:33.900383 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:33.900945 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lazy-loading 'fault' on Instance uuid 00001e41-165d-4dc4-823a-b8cc67f00243 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:37:33.958824 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ca8c6589d0a4bbb9c5adf780cbd2fd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56f6fbec499344859b9da684d29ffdb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:33.975221 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-055e8c26-3556-470d-b2ff-83f7fd7c630a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 200 len: 1351 microversion: 2.1 time: 0.144963 May 27 09:37:33.976901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 75/150] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:33 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 1351 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:34.995437 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-44f66c67-453f-456b-8dca-092d297ee01a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:34.996844 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-44f66c67-453f-456b-8dca-092d297ee01a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:35.007079 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-44f66c67-453f-456b-8dca-092d297ee01a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:35.007715 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-44f66c67-453f-456b-8dca-092d297ee01a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:35.008768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-44f66c67-453f-456b-8dca-092d297ee01a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:35.009543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-44f66c67-453f-456b-8dca-092d297ee01a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:35.029394 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-44f66c67-453f-456b-8dca-092d297ee01a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] HTTP exception thrown: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-44f66c67-453f-456b-8dca-092d297ee01a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Request method failure captured: May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 HTTP/1.1 May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuYxZvbtIV16Jxoid_egZUKSRw2vZXMyUj4VCDhj0HzLK0iZEcJqOvKwyBcw60T-kRTK5dmdvAa6OuJhzKp9m4ZrTcOPstzGAldzmGPgOQEBJ___aKr7kbr5rBebtZ0ETvkvnN0_yiXePepSpVIDyOOVn4uEyvTLTUuFrEbweWuBBE May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 56f6fbec499344859b9da684d29ffdb8 May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:37:35.034517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56f6fbec499344859b9da684d29ffdb8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 56f6fbec499344859b9da684d29ffdb8 May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-DeleteServersTestJSON-1587802789-project May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 2ca8c6589d0a4bbb9c5adf780cbd2fd8 May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-DeleteServersTestJSON-1587802789-project May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:35.037306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '00001e41-165d-4dc4-823a-b8cc67f00243'} May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:37:35.038874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:35.041701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:37:35.046993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-44f66c67-453f-456b-8dca-092d297ee01a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Returning 404 to user: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:37:35.046993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-44f66c67-453f-456b-8dca-092d297ee01a tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 404 len: 111 microversion: 2.1 time: 0.046107 May 27 09:37:35.046993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 76/151] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:34 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:37:36.178819 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b7eb623a-dcac-49be-be53-46fed50aff43 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:36.180689 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b7eb623a-dcac-49be-be53-46fed50aff43 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:36.195521 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7eb623a-dcac-49be-be53-46fed50aff43 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:36.195979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7eb623a-dcac-49be-be53-46fed50aff43 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:36.196779 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7eb623a-dcac-49be-be53-46fed50aff43 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:36.197317 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7eb623a-dcac-49be-be53-46fed50aff43 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:36.211249 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-b7eb623a-dcac-49be-be53-46fed50aff43 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] HTTP exception thrown: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b7eb623a-dcac-49be-be53-46fed50aff43 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Request method failure captured: May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243/os-volume_attachments HTTP/1.1 May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuYxZvbtIV16Jxoid_egZUKSRw2vZXMyUj4VCDhj0HzLK0iZEcJqOvKwyBcw60T-kRTK5dmdvAa6OuJhzKp9m4ZrTcOPstzGAldzmGPgOQEBJ___aKr7kbr5rBebtZ0ETvkvnN0_yiXePepSpVIDyOOVn4uEyvTLTUuFrEbweWuBBE May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 56f6fbec499344859b9da684d29ffdb8 May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:37:36.215628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56f6fbec499344859b9da684d29ffdb8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 56f6fbec499344859b9da684d29ffdb8 May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-DeleteServersTestJSON-1587802789-project May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 2ca8c6589d0a4bbb9c5adf780cbd2fd8 May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-DeleteServersTestJSON-1587802789-project May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:36.218448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'server_id': '00001e41-165d-4dc4-823a-b8cc67f00243'} May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:37:36.219629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:36.221685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:37:36.223722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b7eb623a-dcac-49be-be53-46fed50aff43 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Returning 404 to user: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:37:36.223722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b7eb623a-dcac-49be-be53-46fed50aff43 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046182 May 27 09:37:36.223722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 76/152] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:37:36 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 09:37:38.198044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9cd8ac52-9a1e-4c9d-a864-664584d4fcf8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:38.199160 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9cd8ac52-9a1e-4c9d-a864-664584d4fcf8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:38.211573 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9cd8ac52-9a1e-4c9d-a864-664584d4fcf8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:38.212255 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9cd8ac52-9a1e-4c9d-a864-664584d4fcf8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:38.213421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9cd8ac52-9a1e-4c9d-a864-664584d4fcf8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:38.214221 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9cd8ac52-9a1e-4c9d-a864-664584d4fcf8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:38.238014 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-9cd8ac52-9a1e-4c9d-a864-664584d4fcf8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] HTTP exception thrown: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9cd8ac52-9a1e-4c9d-a864-664584d4fcf8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Request method failure captured: May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: DELETE /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 HTTP/1.1 May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuYxZvbtIV16Jxoid_egZUKSRw2vZXMyUj4VCDhj0HzLK0iZEcJqOvKwyBcw60T-kRTK5dmdvAa6OuJhzKp9m4ZrTcOPstzGAldzmGPgOQEBJ___aKr7kbr5rBebtZ0ETvkvnN0_yiXePepSpVIDyOOVn4uEyvTLTUuFrEbweWuBBE May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 56f6fbec499344859b9da684d29ffdb8 May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:37:38.239909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56f6fbec499344859b9da684d29ffdb8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 56f6fbec499344859b9da684d29ffdb8 May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-DeleteServersTestJSON-1587802789-project May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 2ca8c6589d0a4bbb9c5adf780cbd2fd8 May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-DeleteServersTestJSON-1587802789-project May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:38.242351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '00001e41-165d-4dc4-823a-b8cc67f00243'} May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:37:38.243818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:38.248508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:37:38.254631 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9cd8ac52-9a1e-4c9d-a864-664584d4fcf8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Returning 404 to user: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:37:38.254631 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9cd8ac52-9a1e-4c9d-a864-664584d4fcf8 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "DELETE /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 404 len: 111 microversion: 2.1 time: 0.053363 May 27 09:37:38.257843 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1876aa6e-8570-476b-8710-0ee743effa35 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:38.259818 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1876aa6e-8570-476b-8710-0ee743effa35 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] [instance: 00001e41-165d-4dc4-823a-b8cc67f00243] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:38.260023 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 77/153] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:37:38 2022] DELETE /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:37:38.493620 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1876aa6e-8570-476b-8710-0ee743effa35 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:38.494546 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1876aa6e-8570-476b-8710-0ee743effa35 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:38.495793 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1876aa6e-8570-476b-8710-0ee743effa35 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:38.496412 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1876aa6e-8570-476b-8710-0ee743effa35 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:38.515558 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-1876aa6e-8570-476b-8710-0ee743effa35 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] HTTP exception thrown: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1876aa6e-8570-476b-8710-0ee743effa35 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Request method failure captured: May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 HTTP/1.1 May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuYxZvbtIV16Jxoid_egZUKSRw2vZXMyUj4VCDhj0HzLK0iZEcJqOvKwyBcw60T-kRTK5dmdvAa6OuJhzKp9m4ZrTcOPstzGAldzmGPgOQEBJ___aKr7kbr5rBebtZ0ETvkvnN0_yiXePepSpVIDyOOVn4uEyvTLTUuFrEbweWuBBE May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 56f6fbec499344859b9da684d29ffdb8 May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:37:38.518322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/56f6fbec499344859b9da684d29ffdb8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_56f6fbec499344859b9da684d29ffdb8", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 56f6fbec499344859b9da684d29ffdb8 May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-DeleteServersTestJSON-1587802789 May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-DeleteServersTestJSON-1587802789-project May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 2ca8c6589d0a4bbb9c5adf780cbd2fd8 May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-DeleteServersTestJSON-1587802789-project May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:38.519639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '00001e41-165d-4dc4-823a-b8cc67f00243'} May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:37:38.520270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. May 27 09:37:38.521345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:37:38.522347 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1876aa6e-8570-476b-8710-0ee743effa35 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] Returning 404 to user: Instance 00001e41-165d-4dc4-823a-b8cc67f00243 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:37:38.522347 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1876aa6e-8570-476b-8710-0ee743effa35 tempest-DeleteServersTestJSON-1587802789 tempest-DeleteServersTestJSON-1587802789-project] 10.222.0.48 "GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243" status: 404 len: 111 microversion: 2.1 time: 0.269619 May 27 09:37:38.522347 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 77/154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:38 2022] GET /compute/v2.1/servers/00001e41-165d-4dc4-823a-b8cc67f00243 => generated 111 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:37:50.586296 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:50.590439 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:50.747571 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2093963658", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:37:50.806499 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] validate_networks() for [('486123a6-d792-4300-8761-0207c83d70db', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:37:51.306724 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:37:51.307226 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:37:51.307894 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:37:51.308361 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:37:51.308927 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:37:51.324293 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:51.324903 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:51.325970 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:51.326634 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:51.356339 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Getting quotas for project 91f6b3c676a84127989cc8e35ce91de1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:37:51.362448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Getting quotas for user 5132dcb5580d44e1bc2c7cf4a6893678 and project 91f6b3c676a84127989cc8e35ce91de1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:37:51.377299 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:37:51.379707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:37:51.597941 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-126ec3d4-bc07-4a19-bfed-4c5a6f160d7e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.032342 May 27 09:37:51.599427 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 78/155] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:37:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:37:51.613724 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-869b1bf0-8a93-4420-8161-51163dc92f9d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:51.614683 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-869b1bf0-8a93-4420-8161-51163dc92f9d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:51.618757 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=11 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:51.623276 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:37:51.693248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-869b1bf0-8a93-4420-8161-51163dc92f9d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:51.703050 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-869b1bf0-8a93-4420-8161-51163dc92f9d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1222 microversion: 2.1 time: 0.097614 May 27 09:37:51.703675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 78/156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:51 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:51.783007 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-237969241", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:37:51.906057 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] validate_networks() for [('486123a6-d792-4300-8761-0207c83d70db', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:37:52.704380 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:37:52.705040 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:37:52.706031 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:37:52.706967 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:37:52.707994 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:37:52.722677 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:52.723218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:52.724063 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:52.724506 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:52.743971 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Getting quotas for project 91f6b3c676a84127989cc8e35ce91de1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:37:52.748350 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Getting quotas for user 5132dcb5580d44e1bc2c7cf4a6893678 and project 91f6b3c676a84127989cc8e35ce91de1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:37:52.762470 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:37:52.767290 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:37:53.071971 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ba660f90-e702-4f75-9d61-f5e20fd3f1cc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.293998 May 27 09:37:53.073992 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 79/157] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:37:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:37:53.092854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6c8d85a6-4fd9-4099-afed-359791f453dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:53.095110 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6c8d85a6-4fd9-4099-afed-359791f453dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:53.263154 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-6c8d85a6-4fd9-4099-afed-359791f453dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:53.293877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6c8d85a6-4fd9-4099-afed-359791f453dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1221 microversion: 2.1 time: 0.209838 May 27 09:37:53.297058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 79/158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:53 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1221 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:54.325129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-316c4a93-27b6-45dc-9ccc-2badd7122819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:54.337202 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-316c4a93-27b6-45dc-9ccc-2badd7122819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:54.556366 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-316c4a93-27b6-45dc-9ccc-2badd7122819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:54.571069 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-316c4a93-27b6-45dc-9ccc-2badd7122819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1221 microversion: 2.1 time: 0.257391 May 27 09:37:54.572673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 80/159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:54 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1221 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:55.596892 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4a0e64cc-7bbc-4ec0-aec5-c81d6755c7fe tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:55.597539 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4a0e64cc-7bbc-4ec0-aec5-c81d6755c7fe tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:55.607420 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a0e64cc-7bbc-4ec0-aec5-c81d6755c7fe tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:55.607916 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a0e64cc-7bbc-4ec0-aec5-c81d6755c7fe tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:55.608887 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a0e64cc-7bbc-4ec0-aec5-c81d6755c7fe tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:55.609345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a0e64cc-7bbc-4ec0-aec5-c81d6755c7fe tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:55.796988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4a0e64cc-7bbc-4ec0-aec5-c81d6755c7fe tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:55.809794 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4a0e64cc-7bbc-4ec0-aec5-c81d6755c7fe tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1217 microversion: 2.1 time: 0.217997 May 27 09:37:55.816602 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 80/160] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:55 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1217 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:56.832346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7a69b585-da7f-4024-994b-4c7d1ac5b772 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:56.838357 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7a69b585-da7f-4024-994b-4c7d1ac5b772 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:56.843309 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7a69b585-da7f-4024-994b-4c7d1ac5b772 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:56.846589 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7a69b585-da7f-4024-994b-4c7d1ac5b772 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:56.847697 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7a69b585-da7f-4024-994b-4c7d1ac5b772 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:56.850734 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7a69b585-da7f-4024-994b-4c7d1ac5b772 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:56.963898 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7a69b585-da7f-4024-994b-4c7d1ac5b772 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:56.986924 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7a69b585-da7f-4024-994b-4c7d1ac5b772 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1281 microversion: 2.1 time: 0.161765 May 27 09:37:56.988120 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 81/161] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:56 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1281 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:37:58.019370 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f0f75be8-0dfb-47c4-8299-3ff9f3cd4458 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:58.030074 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f0f75be8-0dfb-47c4-8299-3ff9f3cd4458 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:58.063690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f0f75be8-0dfb-47c4-8299-3ff9f3cd4458 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:58.065650 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f0f75be8-0dfb-47c4-8299-3ff9f3cd4458 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:58.067164 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f0f75be8-0dfb-47c4-8299-3ff9f3cd4458 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:58.068995 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f0f75be8-0dfb-47c4-8299-3ff9f3cd4458 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:58.266586 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f0f75be8-0dfb-47c4-8299-3ff9f3cd4458 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:58.278468 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f0f75be8-0dfb-47c4-8299-3ff9f3cd4458 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1279 microversion: 2.1 time: 0.272843 May 27 09:37:58.279458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 81/162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:58 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1279 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:37:59.300075 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8f842d0c-260e-45db-8ac9-18333670f570 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:37:59.300705 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8f842d0c-260e-45db-8ac9-18333670f570 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:37:59.309557 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8f842d0c-260e-45db-8ac9-18333670f570 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:59.310490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8f842d0c-260e-45db-8ac9-18333670f570 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:59.310888 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8f842d0c-260e-45db-8ac9-18333670f570 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:59.311333 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8f842d0c-260e-45db-8ac9-18333670f570 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:59.564423 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-46715a5a-7dca-49c8-917c-d0606a8ee059 req-c4513b51-f75a-4b87-a920-b4165e681730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f3d6419-841c-47ae-8564-c770ed395103", "tag": "4ebea354-29fe-4bee-8b8d-9d44bd56ea2a"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:37:59.592831 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-46715a5a-7dca-49c8-917c-d0606a8ee059 req-c4513b51-f75a-4b87-a920-b4165e681730 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:37:59.599130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-46715a5a-7dca-49c8-917c-d0606a8ee059 req-c4513b51-f75a-4b87-a920-b4165e681730 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:37:59.637726 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-46715a5a-7dca-49c8-917c-d0606a8ee059 req-c4513b51-f75a-4b87-a920-b4165e681730 service nova] Creating event network-changed:4ebea354-29fe-4bee-8b8d-9d44bd56ea2a for instance 1f3d6419-841c-47ae-8564-c770ed395103 on hv-cinder-82549 May 27 09:37:59.652856 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-46715a5a-7dca-49c8-917c-d0606a8ee059 req-c4513b51-f75a-4b87-a920-b4165e681730 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090335 May 27 09:37:59.653538 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 82/163] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:37:59.767129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8f842d0c-260e-45db-8ac9-18333670f570 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:37:59.796353 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8f842d0c-260e-45db-8ac9-18333670f570 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.503512 May 27 09:37:59.807423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 82/164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:37:59 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:00.770599 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-6afccc17-b227-42f0-beb9-e57fc1fcd4ab req-0cc91fca-d235-41be-a843-73e1e07b782c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1157d082-4c13-4fab-b589-01c5914c6e4e", "tag": "15635276-b81e-4d82-b303-62039515d454"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:00.790152 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-6afccc17-b227-42f0-beb9-e57fc1fcd4ab req-0cc91fca-d235-41be-a843-73e1e07b782c service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:00.790635 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-6afccc17-b227-42f0-beb9-e57fc1fcd4ab req-0cc91fca-d235-41be-a843-73e1e07b782c service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:00.826573 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fb8d7096-6adf-46cb-8b9d-146c0dc8ec89 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:00.827415 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fb8d7096-6adf-46cb-8b9d-146c0dc8ec89 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:00.832743 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-6afccc17-b227-42f0-beb9-e57fc1fcd4ab req-0cc91fca-d235-41be-a843-73e1e07b782c service nova] Creating event network-changed:15635276-b81e-4d82-b303-62039515d454 for instance 1157d082-4c13-4fab-b589-01c5914c6e4e on hv-cinder-82549 May 27 09:38:00.839992 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fb8d7096-6adf-46cb-8b9d-146c0dc8ec89 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:00.845187 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-6afccc17-b227-42f0-beb9-e57fc1fcd4ab req-0cc91fca-d235-41be-a843-73e1e07b782c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077508 May 27 09:38:00.848743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fb8d7096-6adf-46cb-8b9d-146c0dc8ec89 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:00.850232 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fb8d7096-6adf-46cb-8b9d-146c0dc8ec89 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:00.850673 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 83/165] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:38:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:00.855007 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fb8d7096-6adf-46cb-8b9d-146c0dc8ec89 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:01.334283 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fb8d7096-6adf-46cb-8b9d-146c0dc8ec89 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:01.357877 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fb8d7096-6adf-46cb-8b9d-146c0dc8ec89 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.536897 May 27 09:38:01.359678 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 83/166] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:00 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:02.384598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3ed444e2-c89a-4600-922a-d5868deba16c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:02.385314 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3ed444e2-c89a-4600-922a-d5868deba16c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:02.393327 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ed444e2-c89a-4600-922a-d5868deba16c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:02.394006 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ed444e2-c89a-4600-922a-d5868deba16c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:02.394867 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ed444e2-c89a-4600-922a-d5868deba16c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:02.395293 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ed444e2-c89a-4600-922a-d5868deba16c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:02.565873 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3ed444e2-c89a-4600-922a-d5868deba16c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:02.580835 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3ed444e2-c89a-4600-922a-d5868deba16c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.200811 May 27 09:38:02.581895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 84/167] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:02 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:03.601342 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a2102023-1556-4591-95fd-ad3cddbab262 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:03.602558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a2102023-1556-4591-95fd-ad3cddbab262 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:03.605864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=4 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:03.616191 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a2102023-1556-4591-95fd-ad3cddbab262 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:03.617085 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a2102023-1556-4591-95fd-ad3cddbab262 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:03.619563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a2102023-1556-4591-95fd-ad3cddbab262 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:03.619867 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a2102023-1556-4591-95fd-ad3cddbab262 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:03.788934 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a2102023-1556-4591-95fd-ad3cddbab262 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:03.800734 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a2102023-1556-4591-95fd-ad3cddbab262 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.205286 May 27 09:38:03.812685 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 84/168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:03 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:04.819429 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-dacebc9c-9cd3-4efa-b2d9-bc61ab35fc8f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:04.819950 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-dacebc9c-9cd3-4efa-b2d9-bc61ab35fc8f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:04.822216 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=4 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:04.828914 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dacebc9c-9cd3-4efa-b2d9-bc61ab35fc8f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:04.829637 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dacebc9c-9cd3-4efa-b2d9-bc61ab35fc8f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:04.831197 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dacebc9c-9cd3-4efa-b2d9-bc61ab35fc8f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:04.831197 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dacebc9c-9cd3-4efa-b2d9-bc61ab35fc8f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:04.988801 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-dacebc9c-9cd3-4efa-b2d9-bc61ab35fc8f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:04.996630 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-dacebc9c-9cd3-4efa-b2d9-bc61ab35fc8f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.181110 May 27 09:38:04.997229 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 85/169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:04 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:06.016559 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2c61dcab-6bf4-44da-8d9e-b5499bd4572a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:06.017314 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2c61dcab-6bf4-44da-8d9e-b5499bd4572a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:06.019373 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=14 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:06.024466 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c61dcab-6bf4-44da-8d9e-b5499bd4572a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:06.024919 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c61dcab-6bf4-44da-8d9e-b5499bd4572a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:06.025797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c61dcab-6bf4-44da-8d9e-b5499bd4572a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:06.026255 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c61dcab-6bf4-44da-8d9e-b5499bd4572a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:06.162383 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2c61dcab-6bf4-44da-8d9e-b5499bd4572a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:06.174088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2c61dcab-6bf4-44da-8d9e-b5499bd4572a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.163802 May 27 09:38:06.174724 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 85/170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:06 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:07.191373 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0547365a-4dec-41fa-ab80-05ebfae675dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:07.191900 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0547365a-4dec-41fa-ab80-05ebfae675dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:07.198723 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0547365a-4dec-41fa-ab80-05ebfae675dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:07.199177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0547365a-4dec-41fa-ab80-05ebfae675dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:07.199947 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0547365a-4dec-41fa-ab80-05ebfae675dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:07.200417 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0547365a-4dec-41fa-ab80-05ebfae675dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:07.373282 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0547365a-4dec-41fa-ab80-05ebfae675dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:07.381649 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0547365a-4dec-41fa-ab80-05ebfae675dc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.194478 May 27 09:38:07.382120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 86/171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:07 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:08.399720 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3dd210ad-2c48-4f42-8e2a-4e16fde99d40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:08.400835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3dd210ad-2c48-4f42-8e2a-4e16fde99d40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:08.408456 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3dd210ad-2c48-4f42-8e2a-4e16fde99d40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:08.408914 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3dd210ad-2c48-4f42-8e2a-4e16fde99d40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:08.409856 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3dd210ad-2c48-4f42-8e2a-4e16fde99d40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:08.410436 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3dd210ad-2c48-4f42-8e2a-4e16fde99d40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:08.549118 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3dd210ad-2c48-4f42-8e2a-4e16fde99d40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:08.557474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3dd210ad-2c48-4f42-8e2a-4e16fde99d40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.162283 May 27 09:38:08.558181 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 86/172] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:08 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:09.575890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0876bfa2-ed69-41a4-b2c8-cd779812c9ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:09.576536 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0876bfa2-ed69-41a4-b2c8-cd779812c9ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:09.583466 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0876bfa2-ed69-41a4-b2c8-cd779812c9ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:09.583911 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0876bfa2-ed69-41a4-b2c8-cd779812c9ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:09.584688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0876bfa2-ed69-41a4-b2c8-cd779812c9ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:09.585119 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0876bfa2-ed69-41a4-b2c8-cd779812c9ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:09.765047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0876bfa2-ed69-41a4-b2c8-cd779812c9ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:09.772735 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0876bfa2-ed69-41a4-b2c8-cd779812c9ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.201298 May 27 09:38:09.773316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 87/173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:09 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:10.795819 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5c4732a6-b604-474e-b69d-89d17aa0a113 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:10.796778 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5c4732a6-b604-474e-b69d-89d17aa0a113 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:10.803054 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5c4732a6-b604-474e-b69d-89d17aa0a113 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:10.803492 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5c4732a6-b604-474e-b69d-89d17aa0a113 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:10.804725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5c4732a6-b604-474e-b69d-89d17aa0a113 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:10.814683 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5c4732a6-b604-474e-b69d-89d17aa0a113 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:10.967828 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-5c4732a6-b604-474e-b69d-89d17aa0a113 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:10.977266 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5c4732a6-b604-474e-b69d-89d17aa0a113 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.186482 May 27 09:38:10.977942 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 87/174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:10 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:11.994977 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ad9fdb65-99a7-4d02-af4b-13130624265a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:11.995616 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ad9fdb65-99a7-4d02-af4b-13130624265a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:12.003514 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ad9fdb65-99a7-4d02-af4b-13130624265a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:12.003970 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ad9fdb65-99a7-4d02-af4b-13130624265a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:12.004754 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ad9fdb65-99a7-4d02-af4b-13130624265a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:12.005196 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ad9fdb65-99a7-4d02-af4b-13130624265a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:12.177628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ad9fdb65-99a7-4d02-af4b-13130624265a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:12.189196 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ad9fdb65-99a7-4d02-af4b-13130624265a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.197398 May 27 09:38:12.190376 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 88/175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:11 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:13.210508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f2c5028e-ed87-4ba3-8bb0-f457b056aeaa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:13.211305 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f2c5028e-ed87-4ba3-8bb0-f457b056aeaa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:13.227944 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f2c5028e-ed87-4ba3-8bb0-f457b056aeaa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:13.231391 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f2c5028e-ed87-4ba3-8bb0-f457b056aeaa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:13.231391 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f2c5028e-ed87-4ba3-8bb0-f457b056aeaa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:13.231391 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f2c5028e-ed87-4ba3-8bb0-f457b056aeaa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:13.338693 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-512b3cce-2d36-48e5-a6b2-257a6c2f95d9 req-33a12edf-8d74-4986-b129-45b4502d90c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3d6419-841c-47ae-8564-c770ed395103", "name": "network-vif-plugged", "status": "completed", "tag": "4ebea354-29fe-4bee-8b8d-9d44bd56ea2a"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:13.350458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-512b3cce-2d36-48e5-a6b2-257a6c2f95d9 req-33a12edf-8d74-4986-b129-45b4502d90c0 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:13.351127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-512b3cce-2d36-48e5-a6b2-257a6c2f95d9 req-33a12edf-8d74-4986-b129-45b4502d90c0 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:13.375133 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-512b3cce-2d36-48e5-a6b2-257a6c2f95d9 req-33a12edf-8d74-4986-b129-45b4502d90c0 service nova] Creating event network-vif-plugged:4ebea354-29fe-4bee-8b8d-9d44bd56ea2a for instance 1f3d6419-841c-47ae-8564-c770ed395103 on hv-cinder-82549 May 27 09:38:13.382654 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-512b3cce-2d36-48e5-a6b2-257a6c2f95d9 req-33a12edf-8d74-4986-b129-45b4502d90c0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050771 May 27 09:38:13.383650 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 89/176] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:38:13.706869 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f2c5028e-ed87-4ba3-8bb0-f457b056aeaa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:13.741389 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f2c5028e-ed87-4ba3-8bb0-f457b056aeaa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.535347 May 27 09:38:13.743723 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 88/177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:13 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:14.761000 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-66332449-f337-4022-87c6-595ffeed6514 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:14.761702 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-66332449-f337-4022-87c6-595ffeed6514 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:14.768854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-66332449-f337-4022-87c6-595ffeed6514 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:14.769299 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-66332449-f337-4022-87c6-595ffeed6514 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:14.770081 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-66332449-f337-4022-87c6-595ffeed6514 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:14.770539 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-66332449-f337-4022-87c6-595ffeed6514 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:14.949151 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-66332449-f337-4022-87c6-595ffeed6514 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:14.960927 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-66332449-f337-4022-87c6-595ffeed6514 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.204336 May 27 09:38:14.970663 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 90/178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:14 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:15.978474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-dba10d79-dd51-442f-ae88-4c3d6ce308f1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:15.978994 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-dba10d79-dd51-442f-ae88-4c3d6ce308f1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:15.985263 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dba10d79-dd51-442f-ae88-4c3d6ce308f1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:15.985742 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dba10d79-dd51-442f-ae88-4c3d6ce308f1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:15.986545 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dba10d79-dd51-442f-ae88-4c3d6ce308f1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:15.987052 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dba10d79-dd51-442f-ae88-4c3d6ce308f1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:16.164851 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-dba10d79-dd51-442f-ae88-4c3d6ce308f1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:16.170484 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-dba10d79-dd51-442f-ae88-4c3d6ce308f1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.195479 May 27 09:38:16.171455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 89/179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:15 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:17.193389 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4fb8673d-d2a1-4c12-9d7e-348e302dbfee tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:17.194183 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4fb8673d-d2a1-4c12-9d7e-348e302dbfee tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:17.204762 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4fb8673d-d2a1-4c12-9d7e-348e302dbfee tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:17.205560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4fb8673d-d2a1-4c12-9d7e-348e302dbfee tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:17.206986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4fb8673d-d2a1-4c12-9d7e-348e302dbfee tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:17.208017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4fb8673d-d2a1-4c12-9d7e-348e302dbfee tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:17.461899 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-fc9c1222-59d7-4310-8a94-3bf4274186a6 req-bfeb8537-1a22-4af5-8f54-f3774f1098f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1157d082-4c13-4fab-b589-01c5914c6e4e", "name": "network-vif-plugged", "status": "completed", "tag": "15635276-b81e-4d82-b303-62039515d454"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:17.479977 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4fb8673d-d2a1-4c12-9d7e-348e302dbfee tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:17.487593 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-fc9c1222-59d7-4310-8a94-3bf4274186a6 req-bfeb8537-1a22-4af5-8f54-f3774f1098f7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:17.488401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-fc9c1222-59d7-4310-8a94-3bf4274186a6 req-bfeb8537-1a22-4af5-8f54-f3774f1098f7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:17.490798 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4fb8673d-d2a1-4c12-9d7e-348e302dbfee tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.304215 May 27 09:38:17.500943 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 91/180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:17 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:17.504032 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-fc9c1222-59d7-4310-8a94-3bf4274186a6 req-bfeb8537-1a22-4af5-8f54-f3774f1098f7 service nova] Creating event network-vif-plugged:15635276-b81e-4d82-b303-62039515d454 for instance 1157d082-4c13-4fab-b589-01c5914c6e4e on hv-cinder-82549 May 27 09:38:17.510369 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-fc9c1222-59d7-4310-8a94-3bf4274186a6 req-bfeb8537-1a22-4af5-8f54-f3774f1098f7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063440 May 27 09:38:17.511378 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 90/181] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:38:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:18.511793 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ea314855-d5de-4889-b164-13089570bdc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:18.512829 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ea314855-d5de-4889-b164-13089570bdc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:18.520435 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ea314855-d5de-4889-b164-13089570bdc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:18.520883 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ea314855-d5de-4889-b164-13089570bdc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:18.521664 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ea314855-d5de-4889-b164-13089570bdc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:18.522093 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ea314855-d5de-4889-b164-13089570bdc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:18.674447 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ea314855-d5de-4889-b164-13089570bdc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:18.695177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ea314855-d5de-4889-b164-13089570bdc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.189606 May 27 09:38:18.717891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 92/182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:18 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:19.723114 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4948ce34-e5fc-4cb7-a69b-2bdba3f15915 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:19.723973 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4948ce34-e5fc-4cb7-a69b-2bdba3f15915 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:19.730744 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4948ce34-e5fc-4cb7-a69b-2bdba3f15915 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:19.731332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4948ce34-e5fc-4cb7-a69b-2bdba3f15915 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:19.732745 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4948ce34-e5fc-4cb7-a69b-2bdba3f15915 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:19.733276 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4948ce34-e5fc-4cb7-a69b-2bdba3f15915 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:19.890305 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4948ce34-e5fc-4cb7-a69b-2bdba3f15915 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:19.897890 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4948ce34-e5fc-4cb7-a69b-2bdba3f15915 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1321 microversion: 2.1 time: 0.179241 May 27 09:38:19.898485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 91/183] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:19 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:20.916097 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a8e6dcf9-d402-4f95-b752-185137a81e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:20.916727 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a8e6dcf9-d402-4f95-b752-185137a81e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:20.923576 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a8e6dcf9-d402-4f95-b752-185137a81e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:20.924033 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a8e6dcf9-d402-4f95-b752-185137a81e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:20.924824 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a8e6dcf9-d402-4f95-b752-185137a81e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:20.925262 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a8e6dcf9-d402-4f95-b752-185137a81e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:21.162066 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a8e6dcf9-d402-4f95-b752-185137a81e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:21.173040 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a8e6dcf9-d402-4f95-b752-185137a81e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1515 microversion: 2.1 time: 0.260794 May 27 09:38:21.173633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 93/184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:20 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1515 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:21.200612 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-74c373cb-cf5b-429c-9128-2987d7a4c295 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:21.201914 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-74c373cb-cf5b-429c-9128-2987d7a4c295 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:21.211062 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-74c373cb-cf5b-429c-9128-2987d7a4c295 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:21.211876 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-74c373cb-cf5b-429c-9128-2987d7a4c295 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:21.212943 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-74c373cb-cf5b-429c-9128-2987d7a4c295 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:21.213631 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-74c373cb-cf5b-429c-9128-2987d7a4c295 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:21.250166 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-74c373cb-cf5b-429c-9128-2987d7a4c295 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lazy-loading 'flavor' on Instance uuid 1157d082-4c13-4fab-b589-01c5914c6e4e {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:38:21.930506 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-74c373cb-cf5b-429c-9128-2987d7a4c295 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e/action" status: 200 len: 32 microversion: 2.1 time: 0.731728 May 27 09:38:21.931876 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 92/185] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:38:21 2022] POST /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e/action => generated 32 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:38:21.942352 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-037e0383-804c-4d4c-a1cc-8e0cce35f0d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:21.943220 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-037e0383-804c-4d4c-a1cc-8e0cce35f0d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:21.954266 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-037e0383-804c-4d4c-a1cc-8e0cce35f0d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:21.955106 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-037e0383-804c-4d4c-a1cc-8e0cce35f0d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:21.955923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-037e0383-804c-4d4c-a1cc-8e0cce35f0d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:21.957356 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-037e0383-804c-4d4c-a1cc-8e0cce35f0d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:22.180205 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-037e0383-804c-4d4c-a1cc-8e0cce35f0d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:22.193477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-037e0383-804c-4d4c-a1cc-8e0cce35f0d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.254761 May 27 09:38:22.194551 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 94/186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:21 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:23.214048 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fe076e2b-e4fa-4dc7-95ef-7061769a8435 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:23.215249 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fe076e2b-e4fa-4dc7-95ef-7061769a8435 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:23.218441 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:23.225497 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe076e2b-e4fa-4dc7-95ef-7061769a8435 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:23.229803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe076e2b-e4fa-4dc7-95ef-7061769a8435 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:23.229803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe076e2b-e4fa-4dc7-95ef-7061769a8435 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:23.229803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe076e2b-e4fa-4dc7-95ef-7061769a8435 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:23.232748 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:23.428076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fe076e2b-e4fa-4dc7-95ef-7061769a8435 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:23.436589 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fe076e2b-e4fa-4dc7-95ef-7061769a8435 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.227712 May 27 09:38:23.437209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 93/187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:23 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:24.453849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-851e8b58-b0d4-4c03-9fc4-fb785133675c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:24.454803 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-851e8b58-b0d4-4c03-9fc4-fb785133675c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:24.457429 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=39 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:24.462934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-851e8b58-b0d4-4c03-9fc4-fb785133675c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:24.463390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-851e8b58-b0d4-4c03-9fc4-fb785133675c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:24.464177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-851e8b58-b0d4-4c03-9fc4-fb785133675c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:24.464619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-851e8b58-b0d4-4c03-9fc4-fb785133675c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:24.643940 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-851e8b58-b0d4-4c03-9fc4-fb785133675c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:24.651923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-851e8b58-b0d4-4c03-9fc4-fb785133675c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.202399 May 27 09:38:24.658346 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 95/188] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:24 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:25.680641 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fe10cd2e-ef00-4709-a0af-bfcd1cb74adf tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:25.680641 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fe10cd2e-ef00-4709-a0af-bfcd1cb74adf tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:25.692196 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe10cd2e-ef00-4709-a0af-bfcd1cb74adf tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:25.693076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe10cd2e-ef00-4709-a0af-bfcd1cb74adf tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:25.694659 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe10cd2e-ef00-4709-a0af-bfcd1cb74adf tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:25.696035 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe10cd2e-ef00-4709-a0af-bfcd1cb74adf tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:25.933059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fe10cd2e-ef00-4709-a0af-bfcd1cb74adf tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:25.942433 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fe10cd2e-ef00-4709-a0af-bfcd1cb74adf tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.271740 May 27 09:38:25.943334 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 94/189] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:25 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:26.964547 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-dbd1cfae-eaaa-4439-abd0-adba507e51a7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:26.966044 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-dbd1cfae-eaaa-4439-abd0-adba507e51a7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:26.975186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dbd1cfae-eaaa-4439-abd0-adba507e51a7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:26.976010 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dbd1cfae-eaaa-4439-abd0-adba507e51a7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:26.977011 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dbd1cfae-eaaa-4439-abd0-adba507e51a7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:26.977725 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dbd1cfae-eaaa-4439-abd0-adba507e51a7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:27.173594 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-dbd1cfae-eaaa-4439-abd0-adba507e51a7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:27.182967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-dbd1cfae-eaaa-4439-abd0-adba507e51a7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.222678 May 27 09:38:27.187474 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 96/190] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:26 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:28.206910 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6ce7b29e-e531-4432-aee7-47b91b239463 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:28.208160 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6ce7b29e-e531-4432-aee7-47b91b239463 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:28.221581 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ce7b29e-e531-4432-aee7-47b91b239463 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:28.222454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ce7b29e-e531-4432-aee7-47b91b239463 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:28.223926 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ce7b29e-e531-4432-aee7-47b91b239463 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:28.224837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ce7b29e-e531-4432-aee7-47b91b239463 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:28.411810 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6ce7b29e-e531-4432-aee7-47b91b239463 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:28.424747 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6ce7b29e-e531-4432-aee7-47b91b239463 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.226133 May 27 09:38:28.425822 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 95/191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:28 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:29.473609 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-41ece45e-3b04-40e3-9b54-cf1aced0e81e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:29.479542 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-41ece45e-3b04-40e3-9b54-cf1aced0e81e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:29.499293 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41ece45e-3b04-40e3-9b54-cf1aced0e81e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:29.499746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41ece45e-3b04-40e3-9b54-cf1aced0e81e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:29.500534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41ece45e-3b04-40e3-9b54-cf1aced0e81e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:29.501002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41ece45e-3b04-40e3-9b54-cf1aced0e81e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:29.506129 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=91 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:29.654515 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-41ece45e-3b04-40e3-9b54-cf1aced0e81e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:29.667979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-41ece45e-3b04-40e3-9b54-cf1aced0e81e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.227103 May 27 09:38:29.669269 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 97/192] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:29 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:30.690817 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-029f9a46-00ea-4f60-b964-af18025afdad tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:30.691545 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-029f9a46-00ea-4f60-b964-af18025afdad tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:30.708038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-029f9a46-00ea-4f60-b964-af18025afdad tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:30.709093 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-029f9a46-00ea-4f60-b964-af18025afdad tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:30.710808 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-029f9a46-00ea-4f60-b964-af18025afdad tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:30.711653 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-029f9a46-00ea-4f60-b964-af18025afdad tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:30.977456 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-029f9a46-00ea-4f60-b964-af18025afdad tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:30.986433 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-029f9a46-00ea-4f60-b964-af18025afdad tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.303894 May 27 09:38:30.987138 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 96/193] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:30 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:32.021113 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4986c34c-a4a3-43cf-80ff-e6d7b99c0c17 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:32.021735 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4986c34c-a4a3-43cf-80ff-e6d7b99c0c17 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:32.029761 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4986c34c-a4a3-43cf-80ff-e6d7b99c0c17 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:32.030231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4986c34c-a4a3-43cf-80ff-e6d7b99c0c17 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:32.031015 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4986c34c-a4a3-43cf-80ff-e6d7b99c0c17 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:32.031445 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4986c34c-a4a3-43cf-80ff-e6d7b99c0c17 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:32.452342 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4986c34c-a4a3-43cf-80ff-e6d7b99c0c17 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:32.462328 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4986c34c-a4a3-43cf-80ff-e6d7b99c0c17 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.444871 May 27 09:38:32.473573 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 98/194] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:32 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:33.481100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e0312a90-117c-4016-bf58-4c2c6db6e129 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:33.481937 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e0312a90-117c-4016-bf58-4c2c6db6e129 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:33.488581 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0312a90-117c-4016-bf58-4c2c6db6e129 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:33.489038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0312a90-117c-4016-bf58-4c2c6db6e129 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:33.489827 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0312a90-117c-4016-bf58-4c2c6db6e129 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:33.490362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0312a90-117c-4016-bf58-4c2c6db6e129 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:33.777970 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e0312a90-117c-4016-bf58-4c2c6db6e129 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:33.787416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e0312a90-117c-4016-bf58-4c2c6db6e129 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.310187 May 27 09:38:33.788293 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 97/195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:33 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:34.814862 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ba660172-3fde-4493-b244-dd996ef33ee0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:34.816684 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ba660172-3fde-4493-b244-dd996ef33ee0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:34.824497 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba660172-3fde-4493-b244-dd996ef33ee0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:34.825281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba660172-3fde-4493-b244-dd996ef33ee0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:34.826774 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba660172-3fde-4493-b244-dd996ef33ee0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:34.827356 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba660172-3fde-4493-b244-dd996ef33ee0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:34.866880 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-994812653", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "networks": [{"uuid": "474346cf-66a0-4208-a351-508ffc757bc6"}]}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:34.945337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] validate_networks() for [('474346cf-66a0-4208-a351-508ffc757bc6', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:38:35.061075 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ba660172-3fde-4493-b244-dd996ef33ee0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:35.069826 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ba660172-3fde-4493-b244-dd996ef33ee0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.260398 May 27 09:38:35.070745 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 99/196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:34 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:35.482344 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:38:35.483215 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:38:35.484020 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:38:35.484440 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:38:35.484857 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:38:35.495084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:35.495549 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:35.496381 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:35.496821 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:35.519279 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Getting quotas for project 313701a0b7184376946ba96a22c05ad1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:38:35.530072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Getting quotas for user c853e08893d741a9993289a223d2fbca and project 313701a0b7184376946ba96a22c05ad1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:38:35.537804 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:38:35.541477 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:38:35.719975 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e06fbe55-89f9-4b5a-8802-09b578271777 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857539 May 27 09:38:35.721084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 98/197] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:38:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 09:38:35.731307 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-85d2584f-8d6f-4955-93a8-96bc38e84aa1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:35.732525 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-85d2584f-8d6f-4955-93a8-96bc38e84aa1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:35.789902 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-85d2584f-8d6f-4955-93a8-96bc38e84aa1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:35.798539 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-85d2584f-8d6f-4955-93a8-96bc38e84aa1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1213 microversion: 2.1 time: 0.070704 May 27 09:38:35.798829 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 100/198] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:35 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:36.087411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-cba55995-74ac-42dd-bd44-1951730174a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:36.091629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-cba55995-74ac-42dd-bd44-1951730174a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:36.098285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cba55995-74ac-42dd-bd44-1951730174a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:36.098743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cba55995-74ac-42dd-bd44-1951730174a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:36.099531 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cba55995-74ac-42dd-bd44-1951730174a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:36.099967 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cba55995-74ac-42dd-bd44-1951730174a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:36.315670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cba55995-74ac-42dd-bd44-1951730174a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:36.333706 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-cba55995-74ac-42dd-bd44-1951730174a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.249929 May 27 09:38:36.334902 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 99/199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:36 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:36.817970 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-284d00db-871b-429d-91a7-1539bf9760ad tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:36.822467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-284d00db-871b-429d-91a7-1539bf9760ad tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:36.911281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-284d00db-871b-429d-91a7-1539bf9760ad tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:36.920961 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-284d00db-871b-429d-91a7-1539bf9760ad tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1213 microversion: 2.1 time: 0.108815 May 27 09:38:36.921916 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 101/200] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:36 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1213 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:37.354922 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9c9cd901-ed9f-4206-a04c-74bef591f937 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:37.355902 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9c9cd901-ed9f-4206-a04c-74bef591f937 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:37.364372 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c9cd901-ed9f-4206-a04c-74bef591f937 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:37.364372 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c9cd901-ed9f-4206-a04c-74bef591f937 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:37.365200 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c9cd901-ed9f-4206-a04c-74bef591f937 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:37.365727 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c9cd901-ed9f-4206-a04c-74bef591f937 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:37.565268 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9c9cd901-ed9f-4206-a04c-74bef591f937 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:37.574399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9c9cd901-ed9f-4206-a04c-74bef591f937 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.223425 May 27 09:38:37.576471 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 100/201] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:37 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:37.952159 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-26243b36-f064-43ed-8db6-58f8fa8bbc74 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:37.953345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-26243b36-f064-43ed-8db6-58f8fa8bbc74 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:37.963291 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-26243b36-f064-43ed-8db6-58f8fa8bbc74 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:37.964090 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-26243b36-f064-43ed-8db6-58f8fa8bbc74 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:37.965575 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-26243b36-f064-43ed-8db6-58f8fa8bbc74 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:37.967078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-26243b36-f064-43ed-8db6-58f8fa8bbc74 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:38.054977 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-26243b36-f064-43ed-8db6-58f8fa8bbc74 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:38.063099 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-26243b36-f064-43ed-8db6-58f8fa8bbc74 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1209 microversion: 2.1 time: 0.115438 May 27 09:38:38.063785 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 102/202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:37 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1209 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:38.601923 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ae1f9a3c-1116-4273-8395-bfc41f888086 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:38.603075 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ae1f9a3c-1116-4273-8395-bfc41f888086 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:38.615616 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ae1f9a3c-1116-4273-8395-bfc41f888086 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:38.616874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ae1f9a3c-1116-4273-8395-bfc41f888086 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:38.619223 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ae1f9a3c-1116-4273-8395-bfc41f888086 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:38.620316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ae1f9a3c-1116-4273-8395-bfc41f888086 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:38.886947 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ae1f9a3c-1116-4273-8395-bfc41f888086 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:38.895187 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ae1f9a3c-1116-4273-8395-bfc41f888086 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.298828 May 27 09:38:38.895795 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 101/203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:38 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:39.081861 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3afe9594-6625-441d-8403-6bfb53af4f63 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:39.082753 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3afe9594-6625-441d-8403-6bfb53af4f63 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:39.091485 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3afe9594-6625-441d-8403-6bfb53af4f63 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:39.092271 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3afe9594-6625-441d-8403-6bfb53af4f63 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:39.093361 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3afe9594-6625-441d-8403-6bfb53af4f63 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:39.093993 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3afe9594-6625-441d-8403-6bfb53af4f63 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:39.197058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3afe9594-6625-441d-8403-6bfb53af4f63 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:39.215495 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3afe9594-6625-441d-8403-6bfb53af4f63 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1283 microversion: 2.1 time: 0.137399 May 27 09:38:39.239177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 103/204] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:39 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:39.917381 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-730e1ee0-c1a1-4631-9ed2-b7af792f2cd8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:39.919486 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-730e1ee0-c1a1-4631-9ed2-b7af792f2cd8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:39.926362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-730e1ee0-c1a1-4631-9ed2-b7af792f2cd8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:39.926811 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-730e1ee0-c1a1-4631-9ed2-b7af792f2cd8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:39.927805 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-730e1ee0-c1a1-4631-9ed2-b7af792f2cd8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:39.928243 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-730e1ee0-c1a1-4631-9ed2-b7af792f2cd8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:40.168586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-730e1ee0-c1a1-4631-9ed2-b7af792f2cd8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:40.177557 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-730e1ee0-c1a1-4631-9ed2-b7af792f2cd8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.266558 May 27 09:38:40.178159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 102/205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:39 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:40.242924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3ae21c76-36c0-4ef6-bb58-70cffc59ddc0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:40.243721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3ae21c76-36c0-4ef6-bb58-70cffc59ddc0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:40.251232 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ae21c76-36c0-4ef6-bb58-70cffc59ddc0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:40.251716 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ae21c76-36c0-4ef6-bb58-70cffc59ddc0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:40.252485 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ae21c76-36c0-4ef6-bb58-70cffc59ddc0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:40.252924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ae21c76-36c0-4ef6-bb58-70cffc59ddc0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:40.399255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3ae21c76-36c0-4ef6-bb58-70cffc59ddc0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:40.414056 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3ae21c76-36c0-4ef6-bb58-70cffc59ddc0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1313 microversion: 2.1 time: 0.175227 May 27 09:38:40.415393 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 104/206] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:40 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:40.804890 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-1f93f916-abf7-4cdf-83b2-4dddb058e13c req-460f55e2-4fd8-441a-9bfb-d354c82eb6db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "590d631f-031e-4c40-aaac-243a0d41e310", "tag": "4ae98dc4-e146-4f98-9254-e3785f07f96f"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:40.815047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-1f93f916-abf7-4cdf-83b2-4dddb058e13c req-460f55e2-4fd8-441a-9bfb-d354c82eb6db service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:40.815493 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-1f93f916-abf7-4cdf-83b2-4dddb058e13c req-460f55e2-4fd8-441a-9bfb-d354c82eb6db service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:40.828627 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-1f93f916-abf7-4cdf-83b2-4dddb058e13c req-460f55e2-4fd8-441a-9bfb-d354c82eb6db service nova] Creating event network-changed:4ae98dc4-e146-4f98-9254-e3785f07f96f for instance 590d631f-031e-4c40-aaac-243a0d41e310 on hv-cinder-82549 May 27 09:38:40.834922 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-1f93f916-abf7-4cdf-83b2-4dddb058e13c req-460f55e2-4fd8-441a-9bfb-d354c82eb6db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034606 May 27 09:38:40.835536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 103/207] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:38:41.205595 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0065ef13-37b5-465f-91da-1d0b5c56a859 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:41.206306 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0065ef13-37b5-465f-91da-1d0b5c56a859 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:41.213382 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0065ef13-37b5-465f-91da-1d0b5c56a859 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:41.213939 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0065ef13-37b5-465f-91da-1d0b5c56a859 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:41.214944 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0065ef13-37b5-465f-91da-1d0b5c56a859 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:41.215541 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0065ef13-37b5-465f-91da-1d0b5c56a859 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:41.404868 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0065ef13-37b5-465f-91da-1d0b5c56a859 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:41.413537 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0065ef13-37b5-465f-91da-1d0b5c56a859 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.211929 May 27 09:38:41.415897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 105/208] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:41 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:41.438855 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bdb46f1e-4c6b-497a-a9f5-a340b604e768 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:41.439838 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bdb46f1e-4c6b-497a-a9f5-a340b604e768 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:41.451541 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bdb46f1e-4c6b-497a-a9f5-a340b604e768 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:41.451895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bdb46f1e-4c6b-497a-a9f5-a340b604e768 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:41.452821 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bdb46f1e-4c6b-497a-a9f5-a340b604e768 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:41.453320 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bdb46f1e-4c6b-497a-a9f5-a340b604e768 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:41.915889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bdb46f1e-4c6b-497a-a9f5-a340b604e768 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:41.927658 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bdb46f1e-4c6b-497a-a9f5-a340b604e768 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1313 microversion: 2.1 time: 0.497065 May 27 09:38:41.928979 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 104/209] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:41 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:42.440258 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-48c98c90-eac7-4eb1-b696-f076aae733bc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:42.440903 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-48c98c90-eac7-4eb1-b696-f076aae733bc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:42.447779 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-48c98c90-eac7-4eb1-b696-f076aae733bc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:42.451808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-48c98c90-eac7-4eb1-b696-f076aae733bc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:42.451808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-48c98c90-eac7-4eb1-b696-f076aae733bc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:42.451808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-48c98c90-eac7-4eb1-b696-f076aae733bc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:42.636694 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-48c98c90-eac7-4eb1-b696-f076aae733bc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:42.651511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-48c98c90-eac7-4eb1-b696-f076aae733bc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.214818 May 27 09:38:42.652605 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 106/210] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:42 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:42.946227 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-599810d5-a5e7-4b59-ad01-9149fe792e5e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:42.947121 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-599810d5-a5e7-4b59-ad01-9149fe792e5e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:42.961210 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-599810d5-a5e7-4b59-ad01-9149fe792e5e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:42.961556 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-599810d5-a5e7-4b59-ad01-9149fe792e5e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:42.962353 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-599810d5-a5e7-4b59-ad01-9149fe792e5e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:42.962857 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-599810d5-a5e7-4b59-ad01-9149fe792e5e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:43.154397 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-599810d5-a5e7-4b59-ad01-9149fe792e5e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:43.162355 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-599810d5-a5e7-4b59-ad01-9149fe792e5e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1313 microversion: 2.1 time: 0.219867 May 27 09:38:43.163002 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 105/211] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:42 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:43.676288 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4fddcd78-812e-44e3-b8ec-95f7e038365a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:43.676900 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4fddcd78-812e-44e3-b8ec-95f7e038365a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:43.684586 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4fddcd78-812e-44e3-b8ec-95f7e038365a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:43.685033 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4fddcd78-812e-44e3-b8ec-95f7e038365a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:43.685822 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4fddcd78-812e-44e3-b8ec-95f7e038365a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:43.686281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4fddcd78-812e-44e3-b8ec-95f7e038365a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:43.839490 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4fddcd78-812e-44e3-b8ec-95f7e038365a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:43.848325 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4fddcd78-812e-44e3-b8ec-95f7e038365a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.175889 May 27 09:38:43.848925 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 107/212] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:43 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:44.184906 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-99bfc949-2fa0-4595-bd34-0134e38e3c13 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:44.187229 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-99bfc949-2fa0-4595-bd34-0134e38e3c13 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:44.197375 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-99bfc949-2fa0-4595-bd34-0134e38e3c13 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:44.198246 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-99bfc949-2fa0-4595-bd34-0134e38e3c13 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:44.199832 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-99bfc949-2fa0-4595-bd34-0134e38e3c13 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:44.201130 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-99bfc949-2fa0-4595-bd34-0134e38e3c13 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:44.384399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-99bfc949-2fa0-4595-bd34-0134e38e3c13 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:44.395858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-99bfc949-2fa0-4595-bd34-0134e38e3c13 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1313 microversion: 2.1 time: 0.217936 May 27 09:38:44.399485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 106/213] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:44 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:44.866025 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-44fed07d-1c7c-4047-ab3d-c4b248fd7c01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:44.866890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-44fed07d-1c7c-4047-ab3d-c4b248fd7c01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:44.874527 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44fed07d-1c7c-4047-ab3d-c4b248fd7c01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:44.874986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44fed07d-1c7c-4047-ab3d-c4b248fd7c01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:44.875784 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44fed07d-1c7c-4047-ab3d-c4b248fd7c01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:44.876226 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44fed07d-1c7c-4047-ab3d-c4b248fd7c01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:45.077675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-44fed07d-1c7c-4047-ab3d-c4b248fd7c01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:45.086117 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-44fed07d-1c7c-4047-ab3d-c4b248fd7c01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.224319 May 27 09:38:45.086745 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 108/214] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:44 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:45.419778 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2af8c0f2-73c8-4625-a16e-8f2fcb781f33 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:45.420541 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2af8c0f2-73c8-4625-a16e-8f2fcb781f33 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:45.432435 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2af8c0f2-73c8-4625-a16e-8f2fcb781f33 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:45.433561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2af8c0f2-73c8-4625-a16e-8f2fcb781f33 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:45.435825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2af8c0f2-73c8-4625-a16e-8f2fcb781f33 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:45.436962 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2af8c0f2-73c8-4625-a16e-8f2fcb781f33 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:45.505251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:45.531887 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=6 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:45.635911 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2af8c0f2-73c8-4625-a16e-8f2fcb781f33 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:45.645366 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2af8c0f2-73c8-4625-a16e-8f2fcb781f33 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1313 microversion: 2.1 time: 0.233281 May 27 09:38:45.645961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 107/215] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:45 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:46.105626 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2d55c1f2-5352-4e6f-a4d8-612b62df7910 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:46.108206 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2d55c1f2-5352-4e6f-a4d8-612b62df7910 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:46.118492 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2d55c1f2-5352-4e6f-a4d8-612b62df7910 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:46.119582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2d55c1f2-5352-4e6f-a4d8-612b62df7910 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:46.121100 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2d55c1f2-5352-4e6f-a4d8-612b62df7910 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:46.122522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2d55c1f2-5352-4e6f-a4d8-612b62df7910 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:46.298487 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2d55c1f2-5352-4e6f-a4d8-612b62df7910 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:46.307979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2d55c1f2-5352-4e6f-a4d8-612b62df7910 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.206936 May 27 09:38:46.308746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 109/216] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:46 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:46.665943 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1b2d3901-d185-49e6-8269-51629bdd9878 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:46.666613 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1b2d3901-d185-49e6-8269-51629bdd9878 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:46.674748 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b2d3901-d185-49e6-8269-51629bdd9878 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:46.675220 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b2d3901-d185-49e6-8269-51629bdd9878 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:46.676004 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b2d3901-d185-49e6-8269-51629bdd9878 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:46.676459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b2d3901-d185-49e6-8269-51629bdd9878 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:46.833066 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1b2d3901-d185-49e6-8269-51629bdd9878 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:46.842225 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1b2d3901-d185-49e6-8269-51629bdd9878 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1313 microversion: 2.1 time: 0.181479 May 27 09:38:46.843015 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 108/217] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:46 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:47.326534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e361601d-44b1-4b12-8cf8-f2987faefdba tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:47.327461 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e361601d-44b1-4b12-8cf8-f2987faefdba tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:47.329698 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=4 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:47.336674 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e361601d-44b1-4b12-8cf8-f2987faefdba tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:47.337207 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e361601d-44b1-4b12-8cf8-f2987faefdba tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:47.338250 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e361601d-44b1-4b12-8cf8-f2987faefdba tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:47.338816 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e361601d-44b1-4b12-8cf8-f2987faefdba tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:47.533812 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e361601d-44b1-4b12-8cf8-f2987faefdba tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:47.560895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e361601d-44b1-4b12-8cf8-f2987faefdba tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.230011 May 27 09:38:47.562399 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 110/218] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:47 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:47.866235 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e037212f-ad20-40f2-9e6c-04168e7fa3a2 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:47.869630 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e037212f-ad20-40f2-9e6c-04168e7fa3a2 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:47.879211 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e037212f-ad20-40f2-9e6c-04168e7fa3a2 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:47.879992 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e037212f-ad20-40f2-9e6c-04168e7fa3a2 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:47.883027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e037212f-ad20-40f2-9e6c-04168e7fa3a2 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:47.883786 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e037212f-ad20-40f2-9e6c-04168e7fa3a2 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:48.141199 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e037212f-ad20-40f2-9e6c-04168e7fa3a2 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:48.159992 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e037212f-ad20-40f2-9e6c-04168e7fa3a2 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1313 microversion: 2.1 time: 0.301319 May 27 09:38:48.161539 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 109/219] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:47 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:48.584256 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4a4f1501-e446-40be-9045-86bd12abdeeb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:48.585452 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4a4f1501-e446-40be-9045-86bd12abdeeb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:48.594602 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a4f1501-e446-40be-9045-86bd12abdeeb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:48.595054 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a4f1501-e446-40be-9045-86bd12abdeeb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:48.595873 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a4f1501-e446-40be-9045-86bd12abdeeb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:48.596332 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a4f1501-e446-40be-9045-86bd12abdeeb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:48.780275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4a4f1501-e446-40be-9045-86bd12abdeeb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:48.788835 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4a4f1501-e446-40be-9045-86bd12abdeeb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.208933 May 27 09:38:48.789426 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 111/220] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:48 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:49.189362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-90e1f23e-0690-4328-92e8-73d0cb044558 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:49.190261 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-90e1f23e-0690-4328-92e8-73d0cb044558 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:49.199563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-90e1f23e-0690-4328-92e8-73d0cb044558 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:49.200556 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-90e1f23e-0690-4328-92e8-73d0cb044558 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:49.201433 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-90e1f23e-0690-4328-92e8-73d0cb044558 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:49.201873 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-90e1f23e-0690-4328-92e8-73d0cb044558 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:49.388194 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-90e1f23e-0690-4328-92e8-73d0cb044558 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:49.398991 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-90e1f23e-0690-4328-92e8-73d0cb044558 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1313 microversion: 2.1 time: 0.215656 May 27 09:38:49.399875 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 110/221] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:49 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:49.505676 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-745ab410-5896-463d-b173-050ae7a8432a req-97f3849a-102f-4466-9fdc-89ca4c3f30e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590d631f-031e-4c40-aaac-243a0d41e310", "name": "network-vif-plugged", "status": "completed", "tag": "4ae98dc4-e146-4f98-9254-e3785f07f96f"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:38:49.520579 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-745ab410-5896-463d-b173-050ae7a8432a req-97f3849a-102f-4466-9fdc-89ca4c3f30e5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:49.521346 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-745ab410-5896-463d-b173-050ae7a8432a req-97f3849a-102f-4466-9fdc-89ca4c3f30e5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:49.543062 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-745ab410-5896-463d-b173-050ae7a8432a req-97f3849a-102f-4466-9fdc-89ca4c3f30e5 service nova] Creating event network-vif-plugged:4ae98dc4-e146-4f98-9254-e3785f07f96f for instance 590d631f-031e-4c40-aaac-243a0d41e310 on hv-cinder-82549 May 27 09:38:49.552024 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-745ab410-5896-463d-b173-050ae7a8432a req-97f3849a-102f-4466-9fdc-89ca4c3f30e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052373 May 27 09:38:49.552988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 112/222] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:38:49.808222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1f71f2c6-6d7b-4dcc-8183-06125f81c920 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:49.809737 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1f71f2c6-6d7b-4dcc-8183-06125f81c920 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:49.818793 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1f71f2c6-6d7b-4dcc-8183-06125f81c920 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:49.819587 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1f71f2c6-6d7b-4dcc-8183-06125f81c920 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:49.821010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1f71f2c6-6d7b-4dcc-8183-06125f81c920 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:49.821812 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1f71f2c6-6d7b-4dcc-8183-06125f81c920 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:49.830064 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=100 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:50.075952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1f71f2c6-6d7b-4dcc-8183-06125f81c920 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:50.091318 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1f71f2c6-6d7b-4dcc-8183-06125f81c920 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.287941 May 27 09:38:50.091919 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 111/223] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:49 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:50.420291 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1fbb6220-b593-44ee-9178-3dd42d3b7b3f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:50.420997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1fbb6220-b593-44ee-9178-3dd42d3b7b3f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:50.427717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1fbb6220-b593-44ee-9178-3dd42d3b7b3f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:50.428408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1fbb6220-b593-44ee-9178-3dd42d3b7b3f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:50.429209 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1fbb6220-b593-44ee-9178-3dd42d3b7b3f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:50.429638 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1fbb6220-b593-44ee-9178-3dd42d3b7b3f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:50.577458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1fbb6220-b593-44ee-9178-3dd42d3b7b3f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:50.585611 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1fbb6220-b593-44ee-9178-3dd42d3b7b3f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1313 microversion: 2.1 time: 0.170661 May 27 09:38:50.586231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 113/224] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:50 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:51.109310 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-71f9819e-0b9c-4adf-ae32-ccb1925a17c9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:51.109921 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-71f9819e-0b9c-4adf-ae32-ccb1925a17c9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:51.117434 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71f9819e-0b9c-4adf-ae32-ccb1925a17c9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:51.118175 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71f9819e-0b9c-4adf-ae32-ccb1925a17c9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:51.119186 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71f9819e-0b9c-4adf-ae32-ccb1925a17c9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:51.119672 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71f9819e-0b9c-4adf-ae32-ccb1925a17c9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:51.282915 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-71f9819e-0b9c-4adf-ae32-ccb1925a17c9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:51.291443 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-71f9819e-0b9c-4adf-ae32-ccb1925a17c9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.186098 May 27 09:38:51.292564 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 112/225] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:51 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:51.603776 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-36040e50-b4c1-452e-ad6d-1bb811c8b3d7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:51.604442 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-36040e50-b4c1-452e-ad6d-1bb811c8b3d7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:51.612727 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-36040e50-b4c1-452e-ad6d-1bb811c8b3d7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:51.613183 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-36040e50-b4c1-452e-ad6d-1bb811c8b3d7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:51.614147 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-36040e50-b4c1-452e-ad6d-1bb811c8b3d7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:51.614616 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-36040e50-b4c1-452e-ad6d-1bb811c8b3d7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:51.788685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-36040e50-b4c1-452e-ad6d-1bb811c8b3d7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:51.797167 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-36040e50-b4c1-452e-ad6d-1bb811c8b3d7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1313 microversion: 2.1 time: 0.197345 May 27 09:38:51.797678 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 114/226] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:51 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:52.309419 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2a3fef12-76b0-4d72-bf38-761fc0416e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:52.310119 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2a3fef12-76b0-4d72-bf38-761fc0416e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:52.316954 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2a3fef12-76b0-4d72-bf38-761fc0416e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:52.317403 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2a3fef12-76b0-4d72-bf38-761fc0416e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:52.318280 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2a3fef12-76b0-4d72-bf38-761fc0416e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:52.318662 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2a3fef12-76b0-4d72-bf38-761fc0416e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:52.468807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2a3fef12-76b0-4d72-bf38-761fc0416e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:52.477450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2a3fef12-76b0-4d72-bf38-761fc0416e40 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.172035 May 27 09:38:52.478052 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 113/227] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:52 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:52.815048 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e3d68689-2c84-418a-9f56-e01efeb85dc7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:52.815690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e3d68689-2c84-418a-9f56-e01efeb85dc7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:52.823728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e3d68689-2c84-418a-9f56-e01efeb85dc7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:52.824093 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e3d68689-2c84-418a-9f56-e01efeb85dc7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:52.825507 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e3d68689-2c84-418a-9f56-e01efeb85dc7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:52.825944 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e3d68689-2c84-418a-9f56-e01efeb85dc7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:52.977041 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e3d68689-2c84-418a-9f56-e01efeb85dc7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:52.985733 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e3d68689-2c84-418a-9f56-e01efeb85dc7 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1497 microversion: 2.1 time: 0.174499 May 27 09:38:52.986366 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 115/228] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:52 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:53.495346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-af978d32-d83a-47cf-975e-8c8c0c99cf16 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:53.495914 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-af978d32-d83a-47cf-975e-8c8c0c99cf16 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:53.502960 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-af978d32-d83a-47cf-975e-8c8c0c99cf16 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:53.503409 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-af978d32-d83a-47cf-975e-8c8c0c99cf16 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:53.504187 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-af978d32-d83a-47cf-975e-8c8c0c99cf16 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:53.504624 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-af978d32-d83a-47cf-975e-8c8c0c99cf16 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:53.658715 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-af978d32-d83a-47cf-975e-8c8c0c99cf16 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:53.667875 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-af978d32-d83a-47cf-975e-8c8c0c99cf16 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.176603 May 27 09:38:53.668979 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 114/229] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:53 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:54.686819 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f3b5901b-fee8-45b7-a411-059aebc5af50 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:54.687466 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f3b5901b-fee8-45b7-a411-059aebc5af50 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:54.694696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f3b5901b-fee8-45b7-a411-059aebc5af50 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:54.695145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f3b5901b-fee8-45b7-a411-059aebc5af50 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:54.695937 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f3b5901b-fee8-45b7-a411-059aebc5af50 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:54.696366 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f3b5901b-fee8-45b7-a411-059aebc5af50 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:54.713975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=100 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:54.843884 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f3b5901b-fee8-45b7-a411-059aebc5af50 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:54.852220 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f3b5901b-fee8-45b7-a411-059aebc5af50 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.169326 May 27 09:38:54.853188 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 116/230] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:54 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:55.871098 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f1bcbd1a-2ebe-4298-b120-912e9b2b52aa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:55.872811 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f1bcbd1a-2ebe-4298-b120-912e9b2b52aa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:55.880884 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1bcbd1a-2ebe-4298-b120-912e9b2b52aa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:55.881532 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1bcbd1a-2ebe-4298-b120-912e9b2b52aa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:55.882557 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1bcbd1a-2ebe-4298-b120-912e9b2b52aa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:55.883194 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1bcbd1a-2ebe-4298-b120-912e9b2b52aa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:56.046402 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f1bcbd1a-2ebe-4298-b120-912e9b2b52aa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:56.054806 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f1bcbd1a-2ebe-4298-b120-912e9b2b52aa tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.188529 May 27 09:38:56.055409 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 115/231] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:55 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:57.078514 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-cae53d3b-2c38-456c-be45-1b02f5319ccc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:57.079167 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-cae53d3b-2c38-456c-be45-1b02f5319ccc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:57.081854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=48 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:57.087240 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cae53d3b-2c38-456c-be45-1b02f5319ccc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:57.087792 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cae53d3b-2c38-456c-be45-1b02f5319ccc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:57.088928 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cae53d3b-2c38-456c-be45-1b02f5319ccc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:57.089426 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cae53d3b-2c38-456c-be45-1b02f5319ccc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:57.253194 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cae53d3b-2c38-456c-be45-1b02f5319ccc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:57.261148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-cae53d3b-2c38-456c-be45-1b02f5319ccc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.187329 May 27 09:38:57.267533 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 117/232] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:57 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:58.288652 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a702604a-f5cd-4abe-834b-852a467c1c69 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:58.290189 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a702604a-f5cd-4abe-834b-852a467c1c69 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:58.300095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:38:58.302763 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a702604a-f5cd-4abe-834b-852a467c1c69 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:58.304041 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a702604a-f5cd-4abe-834b-852a467c1c69 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:58.305155 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a702604a-f5cd-4abe-834b-852a467c1c69 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:58.306230 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a702604a-f5cd-4abe-834b-852a467c1c69 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:58.517531 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a702604a-f5cd-4abe-834b-852a467c1c69 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:58.525425 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a702604a-f5cd-4abe-834b-852a467c1c69 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.249008 May 27 09:38:58.526023 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 116/233] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:58 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:38:59.105265 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b1699e16-928b-4e17-be16-10af7441c90a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:59.105891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b1699e16-928b-4e17-be16-10af7441c90a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:59.113023 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b1699e16-928b-4e17-be16-10af7441c90a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:59.113464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b1699e16-928b-4e17-be16-10af7441c90a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:59.114286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b1699e16-928b-4e17-be16-10af7441c90a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:59.114729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b1699e16-928b-4e17-be16-10af7441c90a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:59.144578 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b1699e16-928b-4e17-be16-10af7441c90a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:38:59.543923 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0d00f93e-1a08-41f9-b454-ee4e7479fc01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:59.546344 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0d00f93e-1a08-41f9-b454-ee4e7479fc01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:59.553253 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0d00f93e-1a08-41f9-b454-ee4e7479fc01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:59.553526 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0d00f93e-1a08-41f9-b454-ee4e7479fc01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:59.554472 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0d00f93e-1a08-41f9-b454-ee4e7479fc01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:59.554908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0d00f93e-1a08-41f9-b454-ee4e7479fc01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:59.582406 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b1699e16-928b-4e17-be16-10af7441c90a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 204 len: 0 microversion: 2.1 time: 0.480927 May 27 09:38:59.583003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 118/234] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:38:59 2022] DELETE /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 09:38:59.598286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f7ed9a42-e020-4fa8-8994-40b55ccd5629 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:38:59.598997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f7ed9a42-e020-4fa8-8994-40b55ccd5629 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:38:59.605298 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f7ed9a42-e020-4fa8-8994-40b55ccd5629 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:59.605749 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f7ed9a42-e020-4fa8-8994-40b55ccd5629 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:59.607058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f7ed9a42-e020-4fa8-8994-40b55ccd5629 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:38:59.607489 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f7ed9a42-e020-4fa8-8994-40b55ccd5629 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:38:59.747782 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0d00f93e-1a08-41f9-b454-ee4e7479fc01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:59.756756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0d00f93e-1a08-41f9-b454-ee4e7479fc01 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.217867 May 27 09:38:59.765876 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 117/235] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:59 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:38:59.771126 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f7ed9a42-e020-4fa8-8994-40b55ccd5629 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:38:59.780239 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f7ed9a42-e020-4fa8-8994-40b55ccd5629 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1503 microversion: 2.1 time: 0.186161 May 27 09:38:59.780846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 119/236] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:38:59 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:00.773789 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a8f65a26-60e4-4922-ad55-69e6d3261a5a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:00.774547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a8f65a26-60e4-4922-ad55-69e6d3261a5a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:00.781209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a8f65a26-60e4-4922-ad55-69e6d3261a5a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:00.781665 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a8f65a26-60e4-4922-ad55-69e6d3261a5a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:00.782766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a8f65a26-60e4-4922-ad55-69e6d3261a5a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:00.783210 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a8f65a26-60e4-4922-ad55-69e6d3261a5a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:00.802581 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ba75e8d4-6777-442e-9401-2257f8eed6df tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:00.803953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ba75e8d4-6777-442e-9401-2257f8eed6df tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:00.813962 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba75e8d4-6777-442e-9401-2257f8eed6df tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:00.814462 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba75e8d4-6777-442e-9401-2257f8eed6df tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:00.815262 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba75e8d4-6777-442e-9401-2257f8eed6df tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:00.815700 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba75e8d4-6777-442e-9401-2257f8eed6df tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:00.982964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a8f65a26-60e4-4922-ad55-69e6d3261a5a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:00.992338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a8f65a26-60e4-4922-ad55-69e6d3261a5a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.222392 May 27 09:39:00.993216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 118/237] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:00 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:00.996118 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ba75e8d4-6777-442e-9401-2257f8eed6df tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:01.010094 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ba75e8d4-6777-442e-9401-2257f8eed6df tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1503 microversion: 2.1 time: 0.214866 May 27 09:39:01.011177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 120/238] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:00 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1503 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:02.011606 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a0d7c03e-4b35-4cf5-99fd-bc6369810836 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:02.012313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a0d7c03e-4b35-4cf5-99fd-bc6369810836 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:02.020388 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a0d7c03e-4b35-4cf5-99fd-bc6369810836 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:02.021015 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a0d7c03e-4b35-4cf5-99fd-bc6369810836 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:02.021961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a0d7c03e-4b35-4cf5-99fd-bc6369810836 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:02.022431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a0d7c03e-4b35-4cf5-99fd-bc6369810836 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:02.029225 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-135f2c80-1e79-4954-b12a-deed32d753a6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:02.030179 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-135f2c80-1e79-4954-b12a-deed32d753a6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:02.037519 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-135f2c80-1e79-4954-b12a-deed32d753a6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:02.037981 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-135f2c80-1e79-4954-b12a-deed32d753a6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:02.038794 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-135f2c80-1e79-4954-b12a-deed32d753a6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:02.039234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-135f2c80-1e79-4954-b12a-deed32d753a6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:02.218601 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-135f2c80-1e79-4954-b12a-deed32d753a6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:02.225614 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a0d7c03e-4b35-4cf5-99fd-bc6369810836 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:02.229430 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a0d7c03e-4b35-4cf5-99fd-bc6369810836 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.220462 May 27 09:39:02.229430 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 119/239] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:02 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:02.232722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-135f2c80-1e79-4954-b12a-deed32d753a6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1503 microversion: 2.1 time: 0.207344 May 27 09:39:02.233733 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 121/240] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:02 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1503 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:03.244838 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-eecde215-37d8-474d-9c23-7ff84f949f7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:03.245860 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-eecde215-37d8-474d-9c23-7ff84f949f7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:03.254794 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0efa55f8-f6cd-400b-b8cd-7a11c468ae2f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:03.256448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0efa55f8-f6cd-400b-b8cd-7a11c468ae2f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:03.256639 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eecde215-37d8-474d-9c23-7ff84f949f7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:03.257360 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eecde215-37d8-474d-9c23-7ff84f949f7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:03.258803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eecde215-37d8-474d-9c23-7ff84f949f7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:03.259514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eecde215-37d8-474d-9c23-7ff84f949f7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:03.267053 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0efa55f8-f6cd-400b-b8cd-7a11c468ae2f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:03.267668 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0efa55f8-f6cd-400b-b8cd-7a11c468ae2f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:03.268725 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0efa55f8-f6cd-400b-b8cd-7a11c468ae2f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:03.269512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0efa55f8-f6cd-400b-b8cd-7a11c468ae2f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:03.435016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-eecde215-37d8-474d-9c23-7ff84f949f7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:03.449135 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-eecde215-37d8-474d-9c23-7ff84f949f7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.207793 May 27 09:39:03.450760 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 120/241] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:03 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:03.460653 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0efa55f8-f6cd-400b-b8cd-7a11c468ae2f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:03.474937 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0efa55f8-f6cd-400b-b8cd-7a11c468ae2f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1503 microversion: 2.1 time: 0.226375 May 27 09:39:03.475900 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 122/242] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:03 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1503 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:04.469051 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a6288d9d-6640-4e3b-b868-5463f921570e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:04.469689 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a6288d9d-6640-4e3b-b868-5463f921570e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:04.476504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a6288d9d-6640-4e3b-b868-5463f921570e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:04.476998 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a6288d9d-6640-4e3b-b868-5463f921570e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:04.477781 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a6288d9d-6640-4e3b-b868-5463f921570e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:04.478224 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a6288d9d-6640-4e3b-b868-5463f921570e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:04.494376 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-27ca2c84-f6df-40ad-8cc9-c4298373d6cd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:04.495409 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-27ca2c84-f6df-40ad-8cc9-c4298373d6cd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:04.504861 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-27ca2c84-f6df-40ad-8cc9-c4298373d6cd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:04.505307 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-27ca2c84-f6df-40ad-8cc9-c4298373d6cd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:04.506186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-27ca2c84-f6df-40ad-8cc9-c4298373d6cd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:04.506667 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-27ca2c84-f6df-40ad-8cc9-c4298373d6cd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:04.660247 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a6288d9d-6640-4e3b-b868-5463f921570e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:04.674517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a6288d9d-6640-4e3b-b868-5463f921570e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.209661 May 27 09:39:04.675775 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 121/243] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:04 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:04.696929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-27ca2c84-f6df-40ad-8cc9-c4298373d6cd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:04.710571 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-27ca2c84-f6df-40ad-8cc9-c4298373d6cd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1503 microversion: 2.1 time: 0.220889 May 27 09:39:04.711553 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 123/244] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:04 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:05.699577 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fa356869-e61d-45cb-9839-a51ddb094465 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:05.700117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fa356869-e61d-45cb-9839-a51ddb094465 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:05.706141 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fa356869-e61d-45cb-9839-a51ddb094465 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:05.706622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fa356869-e61d-45cb-9839-a51ddb094465 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:05.707387 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fa356869-e61d-45cb-9839-a51ddb094465 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:05.707824 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fa356869-e61d-45cb-9839-a51ddb094465 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:05.729169 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6c6f112e-cee1-46e2-a72d-691232a45443 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:05.729862 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6c6f112e-cee1-46e2-a72d-691232a45443 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:05.737511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6c6f112e-cee1-46e2-a72d-691232a45443 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:05.737965 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6c6f112e-cee1-46e2-a72d-691232a45443 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:05.738766 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6c6f112e-cee1-46e2-a72d-691232a45443 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:05.739208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6c6f112e-cee1-46e2-a72d-691232a45443 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:05.850691 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fa356869-e61d-45cb-9839-a51ddb094465 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:05.859665 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fa356869-e61d-45cb-9839-a51ddb094465 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.163870 May 27 09:39:05.861193 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 122/245] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:05 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:05.886027 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-6c6f112e-cee1-46e2-a72d-691232a45443 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:05.894541 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6c6f112e-cee1-46e2-a72d-691232a45443 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1503 microversion: 2.1 time: 0.169425 May 27 09:39:05.895411 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 124/246] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:05 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:06.885156 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8cd55754-efbb-464d-bc06-77ddeafc20d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:06.885789 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8cd55754-efbb-464d-bc06-77ddeafc20d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:06.892908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8cd55754-efbb-464d-bc06-77ddeafc20d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:06.893359 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8cd55754-efbb-464d-bc06-77ddeafc20d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:06.894142 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8cd55754-efbb-464d-bc06-77ddeafc20d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:06.894611 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8cd55754-efbb-464d-bc06-77ddeafc20d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:06.916553 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e38e1bda-03cc-4293-9066-6aecddfbbe4c tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:06.917173 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e38e1bda-03cc-4293-9066-6aecddfbbe4c tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:06.923963 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e38e1bda-03cc-4293-9066-6aecddfbbe4c tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:06.924410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e38e1bda-03cc-4293-9066-6aecddfbbe4c tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:06.925254 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e38e1bda-03cc-4293-9066-6aecddfbbe4c tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:06.931562 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e38e1bda-03cc-4293-9066-6aecddfbbe4c tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:07.057194 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8cd55754-efbb-464d-bc06-77ddeafc20d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:07.065927 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8cd55754-efbb-464d-bc06-77ddeafc20d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.185177 May 27 09:39:07.066653 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 123/247] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:06 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:07.125090 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e38e1bda-03cc-4293-9066-6aecddfbbe4c tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:07.134182 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e38e1bda-03cc-4293-9066-6aecddfbbe4c tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1503 microversion: 2.1 time: 0.221441 May 27 09:39:07.134997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 125/248] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:06 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:08.093782 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f976518b-9574-48f0-a8e1-25bb9780de8a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:08.102815 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f976518b-9574-48f0-a8e1-25bb9780de8a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:08.102815 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f976518b-9574-48f0-a8e1-25bb9780de8a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:08.103160 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f976518b-9574-48f0-a8e1-25bb9780de8a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:08.104260 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f976518b-9574-48f0-a8e1-25bb9780de8a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:08.104702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f976518b-9574-48f0-a8e1-25bb9780de8a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:08.155559 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-bfd45299-cfc5-466f-95d7-e0f5fa4479b3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:08.156466 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-bfd45299-cfc5-466f-95d7-e0f5fa4479b3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:08.167021 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bfd45299-cfc5-466f-95d7-e0f5fa4479b3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:08.167594 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bfd45299-cfc5-466f-95d7-e0f5fa4479b3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:08.169425 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bfd45299-cfc5-466f-95d7-e0f5fa4479b3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:08.170099 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bfd45299-cfc5-466f-95d7-e0f5fa4479b3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:08.272997 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f976518b-9574-48f0-a8e1-25bb9780de8a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:08.286436 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f976518b-9574-48f0-a8e1-25bb9780de8a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.197400 May 27 09:39:08.287495 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 124/249] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:08 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:08.337469 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-bfd45299-cfc5-466f-95d7-e0f5fa4479b3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:08.346985 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-bfd45299-cfc5-466f-95d7-e0f5fa4479b3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1503 microversion: 2.1 time: 0.197607 May 27 09:39:08.347748 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 126/250] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:08 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1503 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:09.315362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-cb687f60-4981-4e14-a1ce-f0dff5aa91eb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:09.316459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-cb687f60-4981-4e14-a1ce-f0dff5aa91eb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:09.328103 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb687f60-4981-4e14-a1ce-f0dff5aa91eb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:09.329702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb687f60-4981-4e14-a1ce-f0dff5aa91eb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:09.330811 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb687f60-4981-4e14-a1ce-f0dff5aa91eb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:09.331415 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb687f60-4981-4e14-a1ce-f0dff5aa91eb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:09.376467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b7091b3e-9395-4e03-b5da-910a88de1f34 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:09.380395 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b7091b3e-9395-4e03-b5da-910a88de1f34 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:09.393063 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7091b3e-9395-4e03-b5da-910a88de1f34 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:09.394335 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7091b3e-9395-4e03-b5da-910a88de1f34 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:09.397266 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7091b3e-9395-4e03-b5da-910a88de1f34 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:09.397266 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b7091b3e-9395-4e03-b5da-910a88de1f34 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:09.640243 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b7091b3e-9395-4e03-b5da-910a88de1f34 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:09.658028 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b7091b3e-9395-4e03-b5da-910a88de1f34 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1503 microversion: 2.1 time: 0.293389 May 27 09:39:09.660782 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 127/251] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:09 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1503 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:09.666019 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cb687f60-4981-4e14-a1ce-f0dff5aa91eb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:09.676457 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-cb687f60-4981-4e14-a1ce-f0dff5aa91eb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1521 microversion: 2.1 time: 0.369315 May 27 09:39:09.677395 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 125/252] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:09 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:10.228154 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-6dcf872e-48a1-45d1-8288-91905bc30eae req-25ab73ab-81db-406b-879d-8636b1a8e0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "590d631f-031e-4c40-aaac-243a0d41e310", "name": "network-vif-deleted", "tag": "4ae98dc4-e146-4f98-9254-e3785f07f96f"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:10.237147 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-6dcf872e-48a1-45d1-8288-91905bc30eae req-25ab73ab-81db-406b-879d-8636b1a8e0ac service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:10.237770 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-6dcf872e-48a1-45d1-8288-91905bc30eae req-25ab73ab-81db-406b-879d-8636b1a8e0ac service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:10.250728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-6dcf872e-48a1-45d1-8288-91905bc30eae req-25ab73ab-81db-406b-879d-8636b1a8e0ac service nova] Creating event network-vif-deleted:4ae98dc4-e146-4f98-9254-e3785f07f96f for instance 590d631f-031e-4c40-aaac-243a0d41e310 on hv-cinder-82549 May 27 09:39:10.255920 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-6dcf872e-48a1-45d1-8288-91905bc30eae req-25ab73ab-81db-406b-879d-8636b1a8e0ac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038725 May 27 09:39:10.256528 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 128/253] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:39:10.681633 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:10.682468 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:10.689473 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:10.690254 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:10.691247 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:10.691690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:10.698325 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-de9d4fed-38d3-4ec4-8bca-eddbc70c8544 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:10.700423 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-de9d4fed-38d3-4ec4-8bca-eddbc70c8544 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:10.712167 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-de9d4fed-38d3-4ec4-8bca-eddbc70c8544 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:10.713220 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-de9d4fed-38d3-4ec4-8bca-eddbc70c8544 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:10.714843 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-de9d4fed-38d3-4ec4-8bca-eddbc70c8544 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:10.726243 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-de9d4fed-38d3-4ec4-8bca-eddbc70c8544 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:10.728332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:10.728871 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:10.729533 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lazy-loading 'fault' on Instance uuid 590d631f-031e-4c40-aaac-243a0d41e310 {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:39:10.815819 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:10.831352 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-186b5303-b611-4454-b767-675c7898e38e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 200 len: 1303 microversion: 2.1 time: 0.153554 May 27 09:39:10.832444 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 126/254] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:10 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 1303 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:10.967099 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-de9d4fed-38d3-4ec4-8bca-eddbc70c8544 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:10.975704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-de9d4fed-38d3-4ec4-8bca-eddbc70c8544 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1501 microversion: 2.1 time: 0.283992 May 27 09:39:10.976511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 129/255] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:10 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1501 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:10.996176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-34b636e0-f76e-484a-8ef8-17a359a4bb90 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:10.996176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-34b636e0-f76e-484a-8ef8-17a359a4bb90 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:11.000842 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-34b636e0-f76e-484a-8ef8-17a359a4bb90 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:11.001567 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-34b636e0-f76e-484a-8ef8-17a359a4bb90 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:11.002555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-34b636e0-f76e-484a-8ef8-17a359a4bb90 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:11.003196 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-34b636e0-f76e-484a-8ef8-17a359a4bb90 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:11.021812 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=100 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:11.157856 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-34b636e0-f76e-484a-8ef8-17a359a4bb90 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:11.166243 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-34b636e0-f76e-484a-8ef8-17a359a4bb90 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1516 microversion: 2.1 time: 0.176023 May 27 09:39:11.166829 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 127/256] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:10 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1516 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:11.864360 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-41edf3ec-76de-4025-a862-9451871585e4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:11.865402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-41edf3ec-76de-4025-a862-9451871585e4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: 590d631f-031e-4c40-aaac-243a0d41e310] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:11.876928 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41edf3ec-76de-4025-a862-9451871585e4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:11.877650 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41edf3ec-76de-4025-a862-9451871585e4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:11.878969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41edf3ec-76de-4025-a862-9451871585e4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:11.879625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41edf3ec-76de-4025-a862-9451871585e4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:11.904408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-41edf3ec-76de-4025-a862-9451871585e4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] HTTP exception thrown: Instance 590d631f-031e-4c40-aaac-243a0d41e310 could not be found. May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-41edf3ec-76de-4025-a862-9451871585e4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Request method failure captured: May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 HTTP/1.1 May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJwXfUI6AWqelTQFYZqdHEACK-2dyDG_OO8XwoCCxvgsBrC5X2MjlcE3gUs349LtW1s4Xeutj5JPZTxdIpoMmoNzozBC5JEwaRJipUqKSS7_vg12DJLo4GfAZzf44cn7nU2QhGcP_RBQYTfE123MRX8TSlpbQLV713_bB7laPVHM4iw May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 313701a0b7184376946ba96a22c05ad1 May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-VolumesActionsTest-2002656217 May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:39:11.907464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/313701a0b7184376946ba96a22c05ad1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/313701a0b7184376946ba96a22c05ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/313701a0b7184376946ba96a22c05ad1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_313701a0b7184376946ba96a22c05ad1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-VolumesActionsTest-2002656217 May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 313701a0b7184376946ba96a22c05ad1 May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-VolumesActionsTest-2002656217 May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-VolumesActionsTest-2002656217-project May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: c853e08893d741a9993289a223d2fbca May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-VolumesActionsTest-2002656217-project May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 590d631f-031e-4c40-aaac-243a0d41e310 could not be found. May 27 09:39:11.908986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '590d631f-031e-4c40-aaac-243a0d41e310'} May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 590d631f-031e-4c40-aaac-243a0d41e310 could not be found. May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:39:11.909890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 590d631f-031e-4c40-aaac-243a0d41e310 could not be found. May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 590d631f-031e-4c40-aaac-243a0d41e310 could not be found. May 27 09:39:11.918722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:39:11.921077 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-41edf3ec-76de-4025-a862-9451871585e4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Returning 404 to user: Instance 590d631f-031e-4c40-aaac-243a0d41e310 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:39:11.921077 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-41edf3ec-76de-4025-a862-9451871585e4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310" status: 404 len: 111 microversion: 2.1 time: 0.052576 May 27 09:39:11.921077 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 130/257] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:11 2022] GET /compute/v2.1/servers/590d631f-031e-4c40-aaac-243a0d41e310 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:39:12.060878 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1657136335", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "networks": [{"uuid": "474346cf-66a0-4208-a351-508ffc757bc6"}]}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:12.139232 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] validate_networks() for [('474346cf-66a0-4208-a351-508ffc757bc6', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:39:12.685319 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:39:12.685737 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:39:12.686312 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:39:12.686662 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:39:12.687074 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:39:12.697500 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:12.700189 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:12.700189 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:12.700189 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:12.721502 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Getting quotas for project 313701a0b7184376946ba96a22c05ad1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:39:12.726996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Getting quotas for user c853e08893d741a9993289a223d2fbca and project 313701a0b7184376946ba96a22c05ad1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:39:12.745506 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:39:12.749676 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:39:13.010739 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-96a95165-6c94-4e70-aaff-f88ff8d16957 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955191 May 27 09:39:13.011417 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 128/258] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:39:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:39:13.022727 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f492da19-a42a-49cc-8297-32fa4519b74d tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:13.023546 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f492da19-a42a-49cc-8297-32fa4519b74d tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:13.085254 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f492da19-a42a-49cc-8297-32fa4519b74d tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:13.094721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f492da19-a42a-49cc-8297-32fa4519b74d tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1214 microversion: 2.1 time: 0.075299 May 27 09:39:13.095736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 131/259] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:13 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:14.122659 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-30571379-7266-4b20-8a7d-d6d49aa2afbd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:14.123449 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-30571379-7266-4b20-8a7d-d6d49aa2afbd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:14.138508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-30571379-7266-4b20-8a7d-d6d49aa2afbd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:14.139089 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-30571379-7266-4b20-8a7d-d6d49aa2afbd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:14.139902 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-30571379-7266-4b20-8a7d-d6d49aa2afbd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:14.140335 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-30571379-7266-4b20-8a7d-d6d49aa2afbd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:14.209925 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-30571379-7266-4b20-8a7d-d6d49aa2afbd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:14.221625 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-30571379-7266-4b20-8a7d-d6d49aa2afbd tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1218 microversion: 2.1 time: 0.104281 May 27 09:39:14.222964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 129/260] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:14 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:14.470354 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ae11d158-503e-4bb8-8996-ba2287f828d0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:14.471767 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ae11d158-503e-4bb8-8996-ba2287f828d0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:14.480778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ae11d158-503e-4bb8-8996-ba2287f828d0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:14.481230 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ae11d158-503e-4bb8-8996-ba2287f828d0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:14.482017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ae11d158-503e-4bb8-8996-ba2287f828d0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:14.482719 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ae11d158-503e-4bb8-8996-ba2287f828d0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:14.509441 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-ae11d158-503e-4bb8-8996-ba2287f828d0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lazy-loading 'flavor' on Instance uuid 1f3d6419-841c-47ae-8564-c770ed395103 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:39:14.728912 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:15.071936 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ae11d158-503e-4bb8-8996-ba2287f828d0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103/action" status: 200 len: 32 microversion: 2.1 time: 0.607826 May 27 09:39:15.072541 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 132/261] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:39:14 2022] POST /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103/action => generated 32 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:39:15.082499 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f06f4dc7-92a8-4dc6-a842-18da1ac0a46a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:15.083109 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f06f4dc7-92a8-4dc6-a842-18da1ac0a46a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:15.089546 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f06f4dc7-92a8-4dc6-a842-18da1ac0a46a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:15.089993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f06f4dc7-92a8-4dc6-a842-18da1ac0a46a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:15.090814 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f06f4dc7-92a8-4dc6-a842-18da1ac0a46a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:15.091246 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f06f4dc7-92a8-4dc6-a842-18da1ac0a46a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:15.235801 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f06f4dc7-92a8-4dc6-a842-18da1ac0a46a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:15.249900 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f06f4dc7-92a8-4dc6-a842-18da1ac0a46a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.170955 May 27 09:39:15.255701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 130/262] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:15 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:15.255923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d1b7121c-c7d6-4343-adfc-cff964fb9220 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:15.255923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d1b7121c-c7d6-4343-adfc-cff964fb9220 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:15.261077 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d1b7121c-c7d6-4343-adfc-cff964fb9220 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:15.261748 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d1b7121c-c7d6-4343-adfc-cff964fb9220 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:15.263427 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d1b7121c-c7d6-4343-adfc-cff964fb9220 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:15.263990 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d1b7121c-c7d6-4343-adfc-cff964fb9220 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:15.333756 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d1b7121c-c7d6-4343-adfc-cff964fb9220 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:15.341923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d1b7121c-c7d6-4343-adfc-cff964fb9220 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1218 microversion: 2.1 time: 0.105137 May 27 09:39:15.342782 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 133/263] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:15 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:16.276922 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-642311ea-6990-442a-b0bb-3cc520dc178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:16.277541 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-642311ea-6990-442a-b0bb-3cc520dc178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:16.285228 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-642311ea-6990-442a-b0bb-3cc520dc178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:16.285673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-642311ea-6990-442a-b0bb-3cc520dc178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:16.286496 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-642311ea-6990-442a-b0bb-3cc520dc178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:16.286934 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-642311ea-6990-442a-b0bb-3cc520dc178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:16.360516 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-11847b77-3d1c-4b9d-80b2-9aeb269ef28e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:16.361177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-11847b77-3d1c-4b9d-80b2-9aeb269ef28e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:16.368609 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-11847b77-3d1c-4b9d-80b2-9aeb269ef28e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:16.369059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-11847b77-3d1c-4b9d-80b2-9aeb269ef28e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:16.369982 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-11847b77-3d1c-4b9d-80b2-9aeb269ef28e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:16.370524 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-11847b77-3d1c-4b9d-80b2-9aeb269ef28e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:16.444847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-642311ea-6990-442a-b0bb-3cc520dc178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:16.453807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-642311ea-6990-442a-b0bb-3cc520dc178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.180742 May 27 09:39:16.454471 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 131/264] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:16 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:16.476102 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-11847b77-3d1c-4b9d-80b2-9aeb269ef28e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:16.484585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-11847b77-3d1c-4b9d-80b2-9aeb269ef28e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1210 microversion: 2.1 time: 0.128406 May 27 09:39:16.485182 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 134/265] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:16 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1210 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:17.471369 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-609d77b3-91bb-42f3-b32e-24165e771a05 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:17.472251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-609d77b3-91bb-42f3-b32e-24165e771a05 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:17.478996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-609d77b3-91bb-42f3-b32e-24165e771a05 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:17.479445 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-609d77b3-91bb-42f3-b32e-24165e771a05 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:17.480231 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-609d77b3-91bb-42f3-b32e-24165e771a05 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:17.480671 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-609d77b3-91bb-42f3-b32e-24165e771a05 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:17.513520 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-32f871f3-af7e-4591-a2b0-f7001be952d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:17.514849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-32f871f3-af7e-4591-a2b0-f7001be952d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:17.526756 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-32f871f3-af7e-4591-a2b0-f7001be952d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:17.527575 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-32f871f3-af7e-4591-a2b0-f7001be952d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:17.528936 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-32f871f3-af7e-4591-a2b0-f7001be952d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:17.529747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-32f871f3-af7e-4591-a2b0-f7001be952d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:17.624172 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-32f871f3-af7e-4591-a2b0-f7001be952d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:17.638695 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-32f871f3-af7e-4591-a2b0-f7001be952d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1210 microversion: 2.1 time: 0.132056 May 27 09:39:17.646699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-609d77b3-91bb-42f3-b32e-24165e771a05 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:17.654696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 135/266] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:17 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1210 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:17.666687 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-609d77b3-91bb-42f3-b32e-24165e771a05 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.199147 May 27 09:39:17.668469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 132/267] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:17 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:18.671260 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1711af81-5782-4911-988a-9e744564d2f0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:18.672286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1711af81-5782-4911-988a-9e744564d2f0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:18.679998 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1711af81-5782-4911-988a-9e744564d2f0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:18.680489 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1711af81-5782-4911-988a-9e744564d2f0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:18.681269 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1711af81-5782-4911-988a-9e744564d2f0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:18.681704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1711af81-5782-4911-988a-9e744564d2f0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:18.695842 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d5382e9d-47f8-4e75-bc2a-478f1e87f745 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:18.697047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d5382e9d-47f8-4e75-bc2a-478f1e87f745 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:18.707933 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5382e9d-47f8-4e75-bc2a-478f1e87f745 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:18.708707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5382e9d-47f8-4e75-bc2a-478f1e87f745 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:18.709984 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5382e9d-47f8-4e75-bc2a-478f1e87f745 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:18.710746 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5382e9d-47f8-4e75-bc2a-478f1e87f745 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:18.807713 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1711af81-5782-4911-988a-9e744564d2f0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:18.823392 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1711af81-5782-4911-988a-9e744564d2f0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1274 microversion: 2.1 time: 0.158826 May 27 09:39:18.824393 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 136/268] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:18 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1274 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:18.952958 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d5382e9d-47f8-4e75-bc2a-478f1e87f745 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:18.962283 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d5382e9d-47f8-4e75-bc2a-478f1e87f745 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.273033 May 27 09:39:18.963200 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 133/269] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:18 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:19.855902 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7481594d-5062-4a8a-b2e3-752aab5e5a04 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:19.859995 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7481594d-5062-4a8a-b2e3-752aab5e5a04 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:19.869780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7481594d-5062-4a8a-b2e3-752aab5e5a04 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:19.870670 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7481594d-5062-4a8a-b2e3-752aab5e5a04 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:19.878585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7481594d-5062-4a8a-b2e3-752aab5e5a04 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:19.879388 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7481594d-5062-4a8a-b2e3-752aab5e5a04 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:19.984410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7481594d-5062-4a8a-b2e3-752aab5e5a04 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:19.984671 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0b72f686-eb53-4611-ade8-d2de562d27c5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:19.985377 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0b72f686-eb53-4611-ade8-d2de562d27c5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:19.991811 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0b72f686-eb53-4611-ade8-d2de562d27c5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:19.992263 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0b72f686-eb53-4611-ade8-d2de562d27c5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:19.993073 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0b72f686-eb53-4611-ade8-d2de562d27c5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:19.993520 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0b72f686-eb53-4611-ade8-d2de562d27c5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:19.995604 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7481594d-5062-4a8a-b2e3-752aab5e5a04 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1274 microversion: 2.1 time: 0.147835 May 27 09:39:19.995604 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 137/270] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:19 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1274 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:20.175964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0b72f686-eb53-4611-ade8-d2de562d27c5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:20.185995 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0b72f686-eb53-4611-ade8-d2de562d27c5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.206697 May 27 09:39:20.186702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 134/271] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:19 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:21.015021 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a9a8ba4f-b4bc-4d52-9294-732c6b26dcfc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:21.016263 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a9a8ba4f-b4bc-4d52-9294-732c6b26dcfc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:21.028951 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a9a8ba4f-b4bc-4d52-9294-732c6b26dcfc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:21.029651 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a9a8ba4f-b4bc-4d52-9294-732c6b26dcfc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:21.031189 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a9a8ba4f-b4bc-4d52-9294-732c6b26dcfc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:21.031938 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a9a8ba4f-b4bc-4d52-9294-732c6b26dcfc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:21.098222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a9a8ba4f-b4bc-4d52-9294-732c6b26dcfc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:21.107222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a9a8ba4f-b4bc-4d52-9294-732c6b26dcfc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1274 microversion: 2.1 time: 0.097036 May 27 09:39:21.107802 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 138/272] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:21 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1274 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:21.204010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-79166ebb-fd97-4742-890f-53c403efe927 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:21.204623 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-79166ebb-fd97-4742-890f-53c403efe927 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:21.210771 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-79166ebb-fd97-4742-890f-53c403efe927 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:21.211225 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-79166ebb-fd97-4742-890f-53c403efe927 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:21.349483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-79166ebb-fd97-4742-890f-53c403efe927 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:21.349483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-79166ebb-fd97-4742-890f-53c403efe927 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:21.349483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-79166ebb-fd97-4742-890f-53c403efe927 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:21.351258 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-79166ebb-fd97-4742-890f-53c403efe927 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.148566 May 27 09:39:21.351258 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 135/273] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:21 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:21.548504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-867697ce-844d-409f-87c2-6869090e6899 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:21.548994 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-867697ce-844d-409f-87c2-6869090e6899 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:21.555730 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-867697ce-844d-409f-87c2-6869090e6899 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:21.556178 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-867697ce-844d-409f-87c2-6869090e6899 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:21.556941 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-867697ce-844d-409f-87c2-6869090e6899 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:21.557371 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-867697ce-844d-409f-87c2-6869090e6899 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:21.583714 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-867697ce-844d-409f-87c2-6869090e6899 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/ips" status: 200 len: 145 microversion: 2.1 time: 0.039251 May 27 09:39:21.584293 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 139/274] 10.222.0.48 () {58 vars in 1247 bytes} [Fri May 27 09:39:21 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:22.125926 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bd310fc6-d97f-45e9-9744-8addf5521834 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:22.126577 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bd310fc6-d97f-45e9-9744-8addf5521834 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:22.133592 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bd310fc6-d97f-45e9-9744-8addf5521834 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:22.134037 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bd310fc6-d97f-45e9-9744-8addf5521834 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:22.134886 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bd310fc6-d97f-45e9-9744-8addf5521834 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:22.135321 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bd310fc6-d97f-45e9-9744-8addf5521834 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:22.249617 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bd310fc6-d97f-45e9-9744-8addf5521834 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:22.261593 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bd310fc6-d97f-45e9-9744-8addf5521834 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1274 microversion: 2.1 time: 0.139152 May 27 09:39:22.263640 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 136/275] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:22 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1274 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:22.368674 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b123fae8-dd62-4360-b9e2-0031eef6ca7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:22.373745 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b123fae8-dd62-4360-b9e2-0031eef6ca7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:22.378796 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b123fae8-dd62-4360-b9e2-0031eef6ca7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:22.379554 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b123fae8-dd62-4360-b9e2-0031eef6ca7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:22.381083 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b123fae8-dd62-4360-b9e2-0031eef6ca7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:22.381894 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b123fae8-dd62-4360-b9e2-0031eef6ca7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:22.587316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b123fae8-dd62-4360-b9e2-0031eef6ca7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:22.596685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b123fae8-dd62-4360-b9e2-0031eef6ca7c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.232840 May 27 09:39:22.597832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 140/276] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:22 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:23.281657 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b30f27a6-b026-4522-aeea-45d50d3fdf57 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:23.283695 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b30f27a6-b026-4522-aeea-45d50d3fdf57 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:23.298776 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:23.299917 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=6 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:23.309310 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b30f27a6-b026-4522-aeea-45d50d3fdf57 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.310795 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b30f27a6-b026-4522-aeea-45d50d3fdf57 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.312105 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b30f27a6-b026-4522-aeea-45d50d3fdf57 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.312787 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b30f27a6-b026-4522-aeea-45d50d3fdf57 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.513707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b30f27a6-b026-4522-aeea-45d50d3fdf57 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:23.529418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b30f27a6-b026-4522-aeea-45d50d3fdf57 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1314 microversion: 2.1 time: 0.253044 May 27 09:39:23.530552 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 137/277] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:23 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:23.624098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1891fe37-1592-438c-9899-9f9eef3ba9f7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:23.625043 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1891fe37-1592-438c-9899-9f9eef3ba9f7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:23.627341 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:23.633926 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1891fe37-1592-438c-9899-9f9eef3ba9f7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.634835 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1891fe37-1592-438c-9899-9f9eef3ba9f7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.636422 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1891fe37-1592-438c-9899-9f9eef3ba9f7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:23.637201 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1891fe37-1592-438c-9899-9f9eef3ba9f7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:23.838302 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1891fe37-1592-438c-9899-9f9eef3ba9f7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:23.848688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1891fe37-1592-438c-9899-9f9eef3ba9f7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.230154 May 27 09:39:23.849513 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 141/278] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:23 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:24.565884 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-395c5347-870a-4321-bac9-ef79320a8691 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:24.567054 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-395c5347-870a-4321-bac9-ef79320a8691 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:24.580618 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-395c5347-870a-4321-bac9-ef79320a8691 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.583194 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-395c5347-870a-4321-bac9-ef79320a8691 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:24.583194 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-395c5347-870a-4321-bac9-ef79320a8691 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.583654 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-395c5347-870a-4321-bac9-ef79320a8691 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:24.633115 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-7990ee2f-4d3a-40b5-a9ea-92e9fcce3b25 req-c8d7b260-8d42-4dea-8189-8873a92d7e30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a00493c7-512d-4e39-b167-46c08ea1b09f", "tag": "dc18c36f-6816-4b30-a079-e9e595c82af4"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:24.648297 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-7990ee2f-4d3a-40b5-a9ea-92e9fcce3b25 req-c8d7b260-8d42-4dea-8189-8873a92d7e30 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.649098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-7990ee2f-4d3a-40b5-a9ea-92e9fcce3b25 req-c8d7b260-8d42-4dea-8189-8873a92d7e30 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:24.671729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-7990ee2f-4d3a-40b5-a9ea-92e9fcce3b25 req-c8d7b260-8d42-4dea-8189-8873a92d7e30 service nova] Creating event network-changed:dc18c36f-6816-4b30-a079-e9e595c82af4 for instance a00493c7-512d-4e39-b167-46c08ea1b09f on hv-cinder-82549 May 27 09:39:24.678812 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-7990ee2f-4d3a-40b5-a9ea-92e9fcce3b25 req-c8d7b260-8d42-4dea-8189-8873a92d7e30 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053739 May 27 09:39:24.680170 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 142/279] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:39:24.851264 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-395c5347-870a-4321-bac9-ef79320a8691 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:24.860398 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-395c5347-870a-4321-bac9-ef79320a8691 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1314 microversion: 2.1 time: 0.303238 May 27 09:39:24.861005 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 138/280] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:24 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:24.869232 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8454f482-d729-4bd0-92ac-4a0b50192a03 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:24.869232 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8454f482-d729-4bd0-92ac-4a0b50192a03 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:24.880850 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8454f482-d729-4bd0-92ac-4a0b50192a03 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.881547 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8454f482-d729-4bd0-92ac-4a0b50192a03 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:24.882552 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8454f482-d729-4bd0-92ac-4a0b50192a03 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:24.883315 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8454f482-d729-4bd0-92ac-4a0b50192a03 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:25.050909 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8454f482-d729-4bd0-92ac-4a0b50192a03 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:25.062057 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8454f482-d729-4bd0-92ac-4a0b50192a03 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.197457 May 27 09:39:25.062989 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 143/281] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:24 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:25.601142 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-cf092848-9843-469c-9d9a-e55ad255b50f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2f4fd66-4c5a-4b54-8abb-4f586f9be570"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:25.602672 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-cf092848-9843-469c-9d9a-e55ad255b50f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:25.609311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cf092848-9843-469c-9d9a-e55ad255b50f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:25.609747 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cf092848-9843-469c-9d9a-e55ad255b50f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:25.616084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cf092848-9843-469c-9d9a-e55ad255b50f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:25.616084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cf092848-9843-469c-9d9a-e55ad255b50f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:25.887054 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9f24697d-38f8-453d-b2eb-d2aa62f23b99 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:25.888069 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9f24697d-38f8-453d-b2eb-d2aa62f23b99 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:25.897499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f24697d-38f8-453d-b2eb-d2aa62f23b99 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:25.897968 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f24697d-38f8-453d-b2eb-d2aa62f23b99 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:25.899536 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f24697d-38f8-453d-b2eb-d2aa62f23b99 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:25.900027 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f24697d-38f8-453d-b2eb-d2aa62f23b99 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:26.107375 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9f24697d-38f8-453d-b2eb-d2aa62f23b99 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:26.121380 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9f24697d-38f8-453d-b2eb-d2aa62f23b99 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1314 microversion: 2.1 time: 0.240687 May 27 09:39:26.122920 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 144/282] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:25 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:26.129657 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-428f5e1a-2b1d-403a-99ca-b0c8eac7c40c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:26.130666 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-428f5e1a-2b1d-403a-99ca-b0c8eac7c40c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:26.138142 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-428f5e1a-2b1d-403a-99ca-b0c8eac7c40c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:26.139162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-428f5e1a-2b1d-403a-99ca-b0c8eac7c40c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:26.140308 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-428f5e1a-2b1d-403a-99ca-b0c8eac7c40c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:26.140744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-428f5e1a-2b1d-403a-99ca-b0c8eac7c40c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:26.313431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-428f5e1a-2b1d-403a-99ca-b0c8eac7c40c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:26.321701 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-428f5e1a-2b1d-403a-99ca-b0c8eac7c40c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.197192 May 27 09:39:26.322535 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 145/283] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:26 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:26.806276 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-cf092848-9843-469c-9d9a-e55ad255b50f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.207543 May 27 09:39:26.806276 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 139/284] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:39:25 2022] POST /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/os-volume_attachments => generated 194 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:27.147296 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-55256462-1e1f-4f9a-a014-153f8692f836 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:27.148091 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-55256462-1e1f-4f9a-a014-153f8692f836 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:27.156062 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-55256462-1e1f-4f9a-a014-153f8692f836 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.156512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-55256462-1e1f-4f9a-a014-153f8692f836 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.157504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-55256462-1e1f-4f9a-a014-153f8692f836 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.158134 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-55256462-1e1f-4f9a-a014-153f8692f836 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.335585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-55256462-1e1f-4f9a-a014-153f8692f836 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:27.342398 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2c61fde4-b93e-4e31-873c-38db8e92849d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:27.342398 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2c61fde4-b93e-4e31-873c-38db8e92849d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:27.348017 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c61fde4-b93e-4e31-873c-38db8e92849d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.348495 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c61fde4-b93e-4e31-873c-38db8e92849d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.349412 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c61fde4-b93e-4e31-873c-38db8e92849d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:27.349705 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c61fde4-b93e-4e31-873c-38db8e92849d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:27.353031 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-55256462-1e1f-4f9a-a014-153f8692f836 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1314 microversion: 2.1 time: 0.209221 May 27 09:39:27.355981 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 146/285] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:27 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:27.505629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2c61fde4-b93e-4e31-873c-38db8e92849d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:27.514282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2c61fde4-b93e-4e31-873c-38db8e92849d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.178893 May 27 09:39:27.514883 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 140/286] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:27 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:28.380370 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3c32b726-d0ff-44ee-94fe-5035651621d5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:28.381757 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3c32b726-d0ff-44ee-94fe-5035651621d5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:28.393765 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:28.397903 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c32b726-d0ff-44ee-94fe-5035651621d5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.398616 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c32b726-d0ff-44ee-94fe-5035651621d5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.404245 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c32b726-d0ff-44ee-94fe-5035651621d5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.404245 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c32b726-d0ff-44ee-94fe-5035651621d5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.534636 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f1cb911e-f550-486c-a145-95e0f8e29dd6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:28.535790 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f1cb911e-f550-486c-a145-95e0f8e29dd6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:28.550613 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:28.555084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1cb911e-f550-486c-a145-95e0f8e29dd6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.556019 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1cb911e-f550-486c-a145-95e0f8e29dd6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.556862 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1cb911e-f550-486c-a145-95e0f8e29dd6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:28.557315 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1cb911e-f550-486c-a145-95e0f8e29dd6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:28.705832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3c32b726-d0ff-44ee-94fe-5035651621d5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:28.736364 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3c32b726-d0ff-44ee-94fe-5035651621d5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1314 microversion: 2.1 time: 0.360160 May 27 09:39:28.740879 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 147/287] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:28 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:28.923787 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f1cb911e-f550-486c-a145-95e0f8e29dd6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:28.939104 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f1cb911e-f550-486c-a145-95e0f8e29dd6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.409675 May 27 09:39:28.940144 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 141/288] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:28 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:29.757227 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7ba3f631-f602-4680-a3f6-cdd8f3e98815 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:29.758564 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7ba3f631-f602-4680-a3f6-cdd8f3e98815 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:29.770655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ba3f631-f602-4680-a3f6-cdd8f3e98815 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:29.771452 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ba3f631-f602-4680-a3f6-cdd8f3e98815 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:29.772587 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ba3f631-f602-4680-a3f6-cdd8f3e98815 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:29.773253 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ba3f631-f602-4680-a3f6-cdd8f3e98815 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:29.971095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-26a585a9-c35d-47e1-8a6d-c4d1f002ae87 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:29.972247 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-26a585a9-c35d-47e1-8a6d-c4d1f002ae87 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:30.003510 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-26a585a9-c35d-47e1-8a6d-c4d1f002ae87 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:30.004282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-26a585a9-c35d-47e1-8a6d-c4d1f002ae87 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:30.005732 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-26a585a9-c35d-47e1-8a6d-c4d1f002ae87 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:30.006505 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-26a585a9-c35d-47e1-8a6d-c4d1f002ae87 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:30.043040 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7ba3f631-f602-4680-a3f6-cdd8f3e98815 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:30.054749 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7ba3f631-f602-4680-a3f6-cdd8f3e98815 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1314 microversion: 2.1 time: 0.304513 May 27 09:39:30.059393 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 148/289] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:29 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:30.280013 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-26a585a9-c35d-47e1-8a6d-c4d1f002ae87 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:30.299626 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-26a585a9-c35d-47e1-8a6d-c4d1f002ae87 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.337728 May 27 09:39:30.301246 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 142/290] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:29 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:31.088171 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-25bafeff-a628-4a39-8fd9-a621596c8bd5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:31.099717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-25bafeff-a628-4a39-8fd9-a621596c8bd5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:31.115431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-25bafeff-a628-4a39-8fd9-a621596c8bd5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:31.344162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-25bafeff-a628-4a39-8fd9-a621596c8bd5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.344162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-25bafeff-a628-4a39-8fd9-a621596c8bd5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:31.344162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-25bafeff-a628-4a39-8fd9-a621596c8bd5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.344162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:31.345951 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-25bafeff-a628-4a39-8fd9-a621596c8bd5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:31.345951 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-25bafeff-a628-4a39-8fd9-a621596c8bd5 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1314 microversion: 2.1 time: 0.222965 May 27 09:39:31.345951 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 149/291] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:31 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:31.346245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6ed281de-5fea-4e6a-b5f0-be2931fed98e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:31.346245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6ed281de-5fea-4e6a-b5f0-be2931fed98e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:31.346245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ed281de-5fea-4e6a-b5f0-be2931fed98e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:31.346245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ed281de-5fea-4e6a-b5f0-be2931fed98e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.347000 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ed281de-5fea-4e6a-b5f0-be2931fed98e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:31.347000 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ed281de-5fea-4e6a-b5f0-be2931fed98e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.347000 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:31.482589 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6ed281de-5fea-4e6a-b5f0-be2931fed98e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:31.494900 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6ed281de-5fea-4e6a-b5f0-be2931fed98e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.180983 May 27 09:39:31.508490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 143/292] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:31 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:31.709030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-1105ee62-e21f-4b4d-ae9f-e6a14c26e76c req-d4781c89-8d2d-4d9b-832d-9c8ff1d1b90f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00493c7-512d-4e39-b167-46c08ea1b09f", "name": "network-vif-plugged", "status": "completed", "tag": "dc18c36f-6816-4b30-a079-e9e595c82af4"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:31.718774 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-1105ee62-e21f-4b4d-ae9f-e6a14c26e76c req-d4781c89-8d2d-4d9b-832d-9c8ff1d1b90f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:31.719355 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-1105ee62-e21f-4b4d-ae9f-e6a14c26e76c req-d4781c89-8d2d-4d9b-832d-9c8ff1d1b90f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:31.730456 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-1105ee62-e21f-4b4d-ae9f-e6a14c26e76c req-d4781c89-8d2d-4d9b-832d-9c8ff1d1b90f service nova] Creating event network-vif-plugged:dc18c36f-6816-4b30-a079-e9e595c82af4 for instance a00493c7-512d-4e39-b167-46c08ea1b09f on hv-cinder-82549 May 27 09:39:31.739419 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-1105ee62-e21f-4b4d-ae9f-e6a14c26e76c req-d4781c89-8d2d-4d9b-832d-9c8ff1d1b90f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031014 May 27 09:39:31.739419 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 150/293] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:39:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:32.352350 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-59edec44-9a26-4b3b-a4f4-08c90509512c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:32.356629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a5edf566-43f6-4bbb-a3d0-d32f462082b9 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:32.358033 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-59edec44-9a26-4b3b-a4f4-08c90509512c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:32.363776 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a5edf566-43f6-4bbb-a3d0-d32f462082b9 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:32.382306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a5edf566-43f6-4bbb-a3d0-d32f462082b9 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.382306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a5edf566-43f6-4bbb-a3d0-d32f462082b9 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.382306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a5edf566-43f6-4bbb-a3d0-d32f462082b9 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.382306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a5edf566-43f6-4bbb-a3d0-d32f462082b9 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.384671 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-59edec44-9a26-4b3b-a4f4-08c90509512c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.385342 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-59edec44-9a26-4b3b-a4f4-08c90509512c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.386554 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-59edec44-9a26-4b3b-a4f4-08c90509512c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.387173 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-59edec44-9a26-4b3b-a4f4-08c90509512c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.449398 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-59edec44-9a26-4b3b-a4f4-08c90509512c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/ips" status: 200 len: 150 microversion: 2.20 time: 0.104423 May 27 09:39:32.451433 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 151/294] 10.222.0.48 () {60 vars in 1288 bytes} [Fri May 27 09:39:32 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/ips => generated 150 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:39:32.521333 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b0d97b7b-eb1b-4656-9852-4588647a47cb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:32.523190 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b0d97b7b-eb1b-4656-9852-4588647a47cb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:32.559101 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b0d97b7b-eb1b-4656-9852-4588647a47cb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.559101 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b0d97b7b-eb1b-4656-9852-4588647a47cb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.560936 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b0d97b7b-eb1b-4656-9852-4588647a47cb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:32.561559 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b0d97b7b-eb1b-4656-9852-4588647a47cb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:32.685541 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a5edf566-43f6-4bbb-a3d0-d32f462082b9 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:32.710845 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a5edf566-43f6-4bbb-a3d0-d32f462082b9 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1314 microversion: 2.1 time: 0.368805 May 27 09:39:32.711492 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 144/295] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:32 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:32.829454 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b0d97b7b-eb1b-4656-9852-4588647a47cb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:32.845439 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b0d97b7b-eb1b-4656-9852-4588647a47cb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.335006 May 27 09:39:32.846505 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 152/296] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:32 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:33.735167 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4982f880-6d98-4b12-8b69-e5d6d5424d8e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:33.736003 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4982f880-6d98-4b12-8b69-e5d6d5424d8e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:33.744077 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4982f880-6d98-4b12-8b69-e5d6d5424d8e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:33.744528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4982f880-6d98-4b12-8b69-e5d6d5424d8e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:33.745313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4982f880-6d98-4b12-8b69-e5d6d5424d8e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:33.745762 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4982f880-6d98-4b12-8b69-e5d6d5424d8e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:33.873920 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3982e6a4-cadb-4cd6-b27f-9a790c45d621 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:33.875526 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3982e6a4-cadb-4cd6-b27f-9a790c45d621 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:33.884932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3982e6a4-cadb-4cd6-b27f-9a790c45d621 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:33.885761 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3982e6a4-cadb-4cd6-b27f-9a790c45d621 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:33.886770 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3982e6a4-cadb-4cd6-b27f-9a790c45d621 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:33.887550 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3982e6a4-cadb-4cd6-b27f-9a790c45d621 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:34.037410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4982f880-6d98-4b12-8b69-e5d6d5424d8e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:34.047585 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4982f880-6d98-4b12-8b69-e5d6d5424d8e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1314 microversion: 2.1 time: 0.317134 May 27 09:39:34.048500 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 145/297] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:33 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:34.124825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3982e6a4-cadb-4cd6-b27f-9a790c45d621 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:34.133172 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3982e6a4-cadb-4cd6-b27f-9a790c45d621 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.264750 May 27 09:39:34.134229 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 153/298] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:33 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:35.065821 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f17b1b20-185f-4070-9128-22afb3eae879 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:35.066588 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f17b1b20-185f-4070-9128-22afb3eae879 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:35.073945 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f17b1b20-185f-4070-9128-22afb3eae879 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.074512 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f17b1b20-185f-4070-9128-22afb3eae879 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.075362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f17b1b20-185f-4070-9128-22afb3eae879 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.075800 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f17b1b20-185f-4070-9128-22afb3eae879 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.159664 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-aa4dba95-9afa-4c54-a224-8d0d418d6e53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:35.160293 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-aa4dba95-9afa-4c54-a224-8d0d418d6e53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:35.167244 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aa4dba95-9afa-4c54-a224-8d0d418d6e53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.167702 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aa4dba95-9afa-4c54-a224-8d0d418d6e53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.169175 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aa4dba95-9afa-4c54-a224-8d0d418d6e53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.169667 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aa4dba95-9afa-4c54-a224-8d0d418d6e53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.268970 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f17b1b20-185f-4070-9128-22afb3eae879 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:35.280466 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f17b1b20-185f-4070-9128-22afb3eae879 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1314 microversion: 2.1 time: 0.217430 May 27 09:39:35.282049 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 146/299] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:35 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:35.394791 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-aa4dba95-9afa-4c54-a224-8d0d418d6e53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:35.402701 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-aa4dba95-9afa-4c54-a224-8d0d418d6e53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.251365 May 27 09:39:35.403827 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 154/300] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:35 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:35.873004 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-58c26217-c8e6-4d60-b36e-e81617e53fbf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:35.873350 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-58c26217-c8e6-4d60-b36e-e81617e53fbf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:35.880034 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-58c26217-c8e6-4d60-b36e-e81617e53fbf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.880483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-58c26217-c8e6-4d60-b36e-e81617e53fbf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.881285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-58c26217-c8e6-4d60-b36e-e81617e53fbf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:35.881722 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-58c26217-c8e6-4d60-b36e-e81617e53fbf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:35.908055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-58c26217-c8e6-4d60-b36e-e81617e53fbf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lazy-loading 'flavor' on Instance uuid 68f38432-87c8-46fe-b6fe-4795162677ca {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:39:36.299696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2f8d7cf4-358f-4e21-9dc8-4236ee7510fb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:36.302781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2f8d7cf4-358f-4e21-9dc8-4236ee7510fb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:36.308465 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2f8d7cf4-358f-4e21-9dc8-4236ee7510fb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.309550 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2f8d7cf4-358f-4e21-9dc8-4236ee7510fb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:36.310907 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2f8d7cf4-358f-4e21-9dc8-4236ee7510fb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.311420 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2f8d7cf4-358f-4e21-9dc8-4236ee7510fb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:36.497102 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2f8d7cf4-358f-4e21-9dc8-4236ee7510fb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:36.506237 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2f8d7cf4-358f-4e21-9dc8-4236ee7510fb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1499 microversion: 2.1 time: 0.212293 May 27 09:39:36.506825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 155/301] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:36 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1499 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:36.511568 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-71b251af-1b61-4361-94a5-b151cfe91b60 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:36.512214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-71b251af-1b61-4361-94a5-b151cfe91b60 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:36.523269 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-71b251af-1b61-4361-94a5-b151cfe91b60 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.523710 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-71b251af-1b61-4361-94a5-b151cfe91b60 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:36.524533 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-71b251af-1b61-4361-94a5-b151cfe91b60 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.525018 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-71b251af-1b61-4361-94a5-b151cfe91b60 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:36.628031 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-58c26217-c8e6-4d60-b36e-e81617e53fbf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "POST /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/action" status: 202 len: 0 microversion: 2.20 time: 0.759663 May 27 09:39:36.632051 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 147/302] 10.222.0.48 () {62 vars in 1318 bytes} [Fri May 27 09:39:35 2022] POST /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/action => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 09:39:36.643598 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-504a7815-2af8-4bec-84e9-d807f646a4db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:36.644290 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-504a7815-2af8-4bec-84e9-d807f646a4db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:36.651169 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-504a7815-2af8-4bec-84e9-d807f646a4db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.651612 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-504a7815-2af8-4bec-84e9-d807f646a4db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:36.652418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-504a7815-2af8-4bec-84e9-d807f646a4db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:36.652945 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-504a7815-2af8-4bec-84e9-d807f646a4db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:36.690060 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-71b251af-1b61-4361-94a5-b151cfe91b60 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:36.698731 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-71b251af-1b61-4361-94a5-b151cfe91b60 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.190796 May 27 09:39:36.699317 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 156/303] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:36 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:36.800561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-504a7815-2af8-4bec-84e9-d807f646a4db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:36.815493 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-504a7815-2af8-4bec-84e9-d807f646a4db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:36.817829 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-504a7815-2af8-4bec-84e9-d807f646a4db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:36.820317 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-504a7815-2af8-4bec-84e9-d807f646a4db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.186498 May 27 09:39:36.821346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 148/304] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:36 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:37.724121 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-16d5f74c-538b-4f86-b540-21570aa4106a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:37.741165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-16d5f74c-538b-4f86-b540-21570aa4106a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:37.741165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-16d5f74c-538b-4f86-b540-21570aa4106a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.741165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-16d5f74c-538b-4f86-b540-21570aa4106a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.741165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-16d5f74c-538b-4f86-b540-21570aa4106a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.741518 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-16d5f74c-538b-4f86-b540-21570aa4106a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.752529 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7eb7ab6f-40eb-464f-8a74-4e8da28784a0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:37.753347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7eb7ab6f-40eb-464f-8a74-4e8da28784a0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:37.760444 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7eb7ab6f-40eb-464f-8a74-4e8da28784a0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.760957 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7eb7ab6f-40eb-464f-8a74-4e8da28784a0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.761707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7eb7ab6f-40eb-464f-8a74-4e8da28784a0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.763453 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7eb7ab6f-40eb-464f-8a74-4e8da28784a0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.795759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7eb7ab6f-40eb-464f-8a74-4e8da28784a0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:39:37.907752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-16d5f74c-538b-4f86-b540-21570aa4106a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:37.916089 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-16d5f74c-538b-4f86-b540-21570aa4106a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.199148 May 27 09:39:37.916692 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 157/305] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:37 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:37.926237 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d135dca4-a92b-41f7-9e57-d048733c946c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:37.926994 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d135dca4-a92b-41f7-9e57-d048733c946c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:37.933815 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d135dca4-a92b-41f7-9e57-d048733c946c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.934416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d135dca4-a92b-41f7-9e57-d048733c946c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:37.935287 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d135dca4-a92b-41f7-9e57-d048733c946c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:37.935781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d135dca4-a92b-41f7-9e57-d048733c946c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:38.095504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d135dca4-a92b-41f7-9e57-d048733c946c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:38.102015 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d135dca4-a92b-41f7-9e57-d048733c946c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:38.103573 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d135dca4-a92b-41f7-9e57-d048733c946c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:38.104774 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d135dca4-a92b-41f7-9e57-d048733c946c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.182611 May 27 09:39:38.105333 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 158/306] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:37 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:38.448935 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7eb7ab6f-40eb-464f-8a74-4e8da28784a0 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 204 len: 0 microversion: 2.1 time: 0.699232 May 27 09:39:38.451130 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 149/307] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:39:37 2022] DELETE /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 0 bytes in 703 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:39:38.459708 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-13fb1b45-199e-4382-9d35-6f03c97ea12a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:38.460330 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-13fb1b45-199e-4382-9d35-6f03c97ea12a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:38.467891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-13fb1b45-199e-4382-9d35-6f03c97ea12a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.468487 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-13fb1b45-199e-4382-9d35-6f03c97ea12a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:38.469288 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-13fb1b45-199e-4382-9d35-6f03c97ea12a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.469726 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-13fb1b45-199e-4382-9d35-6f03c97ea12a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:38.639398 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-13fb1b45-199e-4382-9d35-6f03c97ea12a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:38.648534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-13fb1b45-199e-4382-9d35-6f03c97ea12a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.192407 May 27 09:39:38.649408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 159/308] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:38 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:38.782561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-203370de-91d3-4c81-991b-bd24d27f1969 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:38.791291 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-203370de-91d3-4c81-991b-bd24d27f1969 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.792506 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-203370de-91d3-4c81-991b-bd24d27f1969 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:38.872455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-203370de-91d3-4c81-991b-bd24d27f1969 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Going to try to stop instance {{(pid=124828) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 09:39:38.933476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5bf0e5ee-bb37-42ac-9139-9180ffb38da7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:38.934242 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5bf0e5ee-bb37-42ac-9139-9180ffb38da7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:38.941310 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5bf0e5ee-bb37-42ac-9139-9180ffb38da7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.941765 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5bf0e5ee-bb37-42ac-9139-9180ffb38da7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:38.942677 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5bf0e5ee-bb37-42ac-9139-9180ffb38da7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:38.943123 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5bf0e5ee-bb37-42ac-9139-9180ffb38da7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.087866 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-203370de-91d3-4c81-991b-bd24d27f1969 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/action" status: 202 len: 0 microversion: 2.1 time: 0.310800 May 27 09:39:39.091885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 150/309] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:39:38 2022] POST /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:39:39.093983 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5bf0e5ee-bb37-42ac-9139-9180ffb38da7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.098520 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0b470c5e-4574-46c5-a9f2-60fb8de2a390 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:39.099245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0b470c5e-4574-46c5-a9f2-60fb8de2a390 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:39.105498 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0b470c5e-4574-46c5-a9f2-60fb8de2a390 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:39.105950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0b470c5e-4574-46c5-a9f2-60fb8de2a390 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.106778 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0b470c5e-4574-46c5-a9f2-60fb8de2a390 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:39.106919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5bf0e5ee-bb37-42ac-9139-9180ffb38da7 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.176918 May 27 09:39:39.107244 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0b470c5e-4574-46c5-a9f2-60fb8de2a390 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.107984 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 160/310] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:38 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:39.124463 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-764c7332-628a-4aca-896c-2a9b820ce2a3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:39.125403 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-764c7332-628a-4aca-896c-2a9b820ce2a3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:39.132070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-764c7332-628a-4aca-896c-2a9b820ce2a3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:39.132767 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-764c7332-628a-4aca-896c-2a9b820ce2a3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.133748 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-764c7332-628a-4aca-896c-2a9b820ce2a3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:39.134430 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-764c7332-628a-4aca-896c-2a9b820ce2a3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.293536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0b470c5e-4574-46c5-a9f2-60fb8de2a390 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.304431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0b470c5e-4574-46c5-a9f2-60fb8de2a390 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.210804 May 27 09:39:39.305397 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 151/311] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:39 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:39.312836 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-764c7332-628a-4aca-896c-2a9b820ce2a3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.323014 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-764c7332-628a-4aca-896c-2a9b820ce2a3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.325427 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-764c7332-628a-4aca-896c-2a9b820ce2a3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.327405 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-764c7332-628a-4aca-896c-2a9b820ce2a3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.207474 May 27 09:39:39.328360 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 161/312] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:39 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:39.671140 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-cfaeb0e3-b084-43b0-b8ba-b03b20a4c97f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:39.672329 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-cfaeb0e3-b084-43b0-b8ba-b03b20a4c97f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:39.683000 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cfaeb0e3-b084-43b0-b8ba-b03b20a4c97f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:39.683732 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cfaeb0e3-b084-43b0-b8ba-b03b20a4c97f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.685629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cfaeb0e3-b084-43b0-b8ba-b03b20a4c97f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:39.686437 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cfaeb0e3-b084-43b0-b8ba-b03b20a4c97f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:39.865128 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cfaeb0e3-b084-43b0-b8ba-b03b20a4c97f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:39.873527 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-cfaeb0e3-b084-43b0-b8ba-b03b20a4c97f tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.210187 May 27 09:39:39.874133 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 152/313] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:39 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:40.126067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-83239aa2-b23a-4967-8b3b-c4d33ebecd20 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:40.126659 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-83239aa2-b23a-4967-8b3b-c4d33ebecd20 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:40.133746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-83239aa2-b23a-4967-8b3b-c4d33ebecd20 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.134214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-83239aa2-b23a-4967-8b3b-c4d33ebecd20 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.135008 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-83239aa2-b23a-4967-8b3b-c4d33ebecd20 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.135449 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-83239aa2-b23a-4967-8b3b-c4d33ebecd20 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.287315 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-83239aa2-b23a-4967-8b3b-c4d33ebecd20 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:40.295403 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-83239aa2-b23a-4967-8b3b-c4d33ebecd20 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.173345 May 27 09:39:40.296211 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 162/314] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:40 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:40.323769 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5c299a35-ea76-4793-a951-ae9158b01df4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:40.324381 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5c299a35-ea76-4793-a951-ae9158b01df4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:40.331177 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5c299a35-ea76-4793-a951-ae9158b01df4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.331629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5c299a35-ea76-4793-a951-ae9158b01df4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.332402 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5c299a35-ea76-4793-a951-ae9158b01df4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.332839 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5c299a35-ea76-4793-a951-ae9158b01df4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.349840 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-06780dc2-cf70-40d1-8282-71dea0513ee6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:40.350922 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-06780dc2-cf70-40d1-8282-71dea0513ee6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:40.361346 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-06780dc2-cf70-40d1-8282-71dea0513ee6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.362085 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-06780dc2-cf70-40d1-8282-71dea0513ee6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.363448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-06780dc2-cf70-40d1-8282-71dea0513ee6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.364260 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-06780dc2-cf70-40d1-8282-71dea0513ee6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.500213 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-5c299a35-ea76-4793-a951-ae9158b01df4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:40.516242 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5c299a35-ea76-4793-a951-ae9158b01df4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.195999 May 27 09:39:40.517129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 153/315] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:40 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:40.527365 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-06780dc2-cf70-40d1-8282-71dea0513ee6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:40.536861 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-06780dc2-cf70-40d1-8282-71dea0513ee6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:40.538455 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-06780dc2-cf70-40d1-8282-71dea0513ee6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:40.539683 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-06780dc2-cf70-40d1-8282-71dea0513ee6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.194283 May 27 09:39:40.540295 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 163/316] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:40 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:40.895132 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-05e5a6ea-73c1-4809-9f47-049d22be4414 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:40.896036 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-05e5a6ea-73c1-4809-9f47-049d22be4414 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:40.907583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05e5a6ea-73c1-4809-9f47-049d22be4414 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.908353 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05e5a6ea-73c1-4809-9f47-049d22be4414 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:40.909689 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05e5a6ea-73c1-4809-9f47-049d22be4414 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:40.910485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05e5a6ea-73c1-4809-9f47-049d22be4414 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.080807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-05e5a6ea-73c1-4809-9f47-049d22be4414 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:41.088662 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-05e5a6ea-73c1-4809-9f47-049d22be4414 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.198043 May 27 09:39:41.089251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 154/317] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:40 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:41.318019 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-62555184-6eb0-47f9-be88-02f0537bf9dd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:41.319117 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-62555184-6eb0-47f9-be88-02f0537bf9dd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:41.331785 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-62555184-6eb0-47f9-be88-02f0537bf9dd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:41.332462 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-62555184-6eb0-47f9-be88-02f0537bf9dd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.333638 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-62555184-6eb0-47f9-be88-02f0537bf9dd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:41.334453 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-62555184-6eb0-47f9-be88-02f0537bf9dd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.488875 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-62555184-6eb0-47f9-be88-02f0537bf9dd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:41.498335 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-62555184-6eb0-47f9-be88-02f0537bf9dd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.187966 May 27 09:39:41.498930 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 164/318] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:41 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:41.543734 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-488a54dd-0b8a-4eaa-a581-a5a1f6716e4a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:41.544491 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-488a54dd-0b8a-4eaa-a581-a5a1f6716e4a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:41.551963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-488a54dd-0b8a-4eaa-a581-a5a1f6716e4a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:41.552686 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-488a54dd-0b8a-4eaa-a581-a5a1f6716e4a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.553779 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-488a54dd-0b8a-4eaa-a581-a5a1f6716e4a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:41.554265 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-488a54dd-0b8a-4eaa-a581-a5a1f6716e4a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.561376 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c47daa88-2283-42f9-8244-7c14798e1d53 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:41.562555 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c47daa88-2283-42f9-8244-7c14798e1d53 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:41.570800 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:41.573245 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c47daa88-2283-42f9-8244-7c14798e1d53 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:41.574032 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c47daa88-2283-42f9-8244-7c14798e1d53 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.576404 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c47daa88-2283-42f9-8244-7c14798e1d53 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:41.576854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c47daa88-2283-42f9-8244-7c14798e1d53 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:41.728239 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-488a54dd-0b8a-4eaa-a581-a5a1f6716e4a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:41.737044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-488a54dd-0b8a-4eaa-a581-a5a1f6716e4a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.197176 May 27 09:39:41.737630 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 155/319] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:41 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:41.744729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c47daa88-2283-42f9-8244-7c14798e1d53 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:41.754808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c47daa88-2283-42f9-8244-7c14798e1d53 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:41.756855 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c47daa88-2283-42f9-8244-7c14798e1d53 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:41.759925 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c47daa88-2283-42f9-8244-7c14798e1d53 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.203774 May 27 09:39:41.759925 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 165/320] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:41 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:42.108655 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1e6a4bb0-10f9-42e5-afe1-afd9f89fee6a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:42.109185 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1e6a4bb0-10f9-42e5-afe1-afd9f89fee6a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:42.115851 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1e6a4bb0-10f9-42e5-afe1-afd9f89fee6a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.116286 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1e6a4bb0-10f9-42e5-afe1-afd9f89fee6a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.117043 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1e6a4bb0-10f9-42e5-afe1-afd9f89fee6a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.117472 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1e6a4bb0-10f9-42e5-afe1-afd9f89fee6a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.255792 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1e6a4bb0-10f9-42e5-afe1-afd9f89fee6a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.263738 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1e6a4bb0-10f9-42e5-afe1-afd9f89fee6a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.159621 May 27 09:39:42.264455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 156/321] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:42 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:42.516667 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-cb609967-7948-4023-b201-67b0aba47b00 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:42.517284 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-cb609967-7948-4023-b201-67b0aba47b00 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:42.524213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cb609967-7948-4023-b201-67b0aba47b00 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.524662 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cb609967-7948-4023-b201-67b0aba47b00 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.525464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cb609967-7948-4023-b201-67b0aba47b00 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.525867 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cb609967-7948-4023-b201-67b0aba47b00 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.676651 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cb609967-7948-4023-b201-67b0aba47b00 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.685389 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-cb609967-7948-4023-b201-67b0aba47b00 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.173241 May 27 09:39:42.685981 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 166/322] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:42 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:42.755855 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9d46a825-85d9-4e84-83ad-468d88065801 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:42.756467 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9d46a825-85d9-4e84-83ad-468d88065801 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:42.763317 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9d46a825-85d9-4e84-83ad-468d88065801 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.763770 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9d46a825-85d9-4e84-83ad-468d88065801 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.764543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9d46a825-85d9-4e84-83ad-468d88065801 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.764982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9d46a825-85d9-4e84-83ad-468d88065801 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.783047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-87d0eb2f-2b3e-40fb-9940-989e62f277e2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:42.783874 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-87d0eb2f-2b3e-40fb-9940-989e62f277e2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:42.790012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-87d0eb2f-2b3e-40fb-9940-989e62f277e2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.790482 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-87d0eb2f-2b3e-40fb-9940-989e62f277e2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.791250 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-87d0eb2f-2b3e-40fb-9940-989e62f277e2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:42.791687 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-87d0eb2f-2b3e-40fb-9940-989e62f277e2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:42.794937 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=100 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:42.919914 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9d46a825-85d9-4e84-83ad-468d88065801 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.936343 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9d46a825-85d9-4e84-83ad-468d88065801 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.184247 May 27 09:39:42.945978 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 157/323] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:42 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:42.946837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-87d0eb2f-2b3e-40fb-9940-989e62f277e2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.956589 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-87d0eb2f-2b3e-40fb-9940-989e62f277e2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.958289 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-87d0eb2f-2b3e-40fb-9940-989e62f277e2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:42.959506 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-87d0eb2f-2b3e-40fb-9940-989e62f277e2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.180458 May 27 09:39:42.960081 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 167/324] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:42 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:39:43.281061 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2cc59820-96d4-4686-a282-fc66e1729e59 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:43.281692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2cc59820-96d4-4686-a282-fc66e1729e59 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:43.288780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2cc59820-96d4-4686-a282-fc66e1729e59 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.289374 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2cc59820-96d4-4686-a282-fc66e1729e59 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.290398 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2cc59820-96d4-4686-a282-fc66e1729e59 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.290954 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2cc59820-96d4-4686-a282-fc66e1729e59 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.434872 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2cc59820-96d4-4686-a282-fc66e1729e59 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:43.443122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2cc59820-96d4-4686-a282-fc66e1729e59 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.166041 May 27 09:39:43.443710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 158/325] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:43 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:43.702411 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-da954cae-bef4-4eb7-aa9f-d3e60533d2ae tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:43.703061 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-da954cae-bef4-4eb7-aa9f-d3e60533d2ae tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:43.710093 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da954cae-bef4-4eb7-aa9f-d3e60533d2ae tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.710589 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da954cae-bef4-4eb7-aa9f-d3e60533d2ae tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.711379 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da954cae-bef4-4eb7-aa9f-d3e60533d2ae tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.711817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da954cae-bef4-4eb7-aa9f-d3e60533d2ae tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.858584 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-da954cae-bef4-4eb7-aa9f-d3e60533d2ae tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:43.867618 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-da954cae-bef4-4eb7-aa9f-d3e60533d2ae tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.168952 May 27 09:39:43.868414 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 168/326] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:43 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:43.954705 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9092ee1a-fa38-432d-8fb5-e277f6d62152 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:43.955320 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9092ee1a-fa38-432d-8fb5-e277f6d62152 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:43.965227 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9092ee1a-fa38-432d-8fb5-e277f6d62152 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.965982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9092ee1a-fa38-432d-8fb5-e277f6d62152 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.967918 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9092ee1a-fa38-432d-8fb5-e277f6d62152 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.969147 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9092ee1a-fa38-432d-8fb5-e277f6d62152 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.983695 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-05f4b990-d415-4c4d-9f58-f24777c1558d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:43.984946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-05f4b990-d415-4c4d-9f58-f24777c1558d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:43.992281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-05f4b990-d415-4c4d-9f58-f24777c1558d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.992960 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-05f4b990-d415-4c4d-9f58-f24777c1558d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:43.993891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-05f4b990-d415-4c4d-9f58-f24777c1558d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:43.994968 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-05f4b990-d415-4c4d-9f58-f24777c1558d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:44.156305 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-05f4b990-d415-4c4d-9f58-f24777c1558d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:44.159459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9092ee1a-fa38-432d-8fb5-e277f6d62152 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:44.164719 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-05f4b990-d415-4c4d-9f58-f24777c1558d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:44.166241 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-05f4b990-d415-4c4d-9f58-f24777c1558d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:44.167420 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-05f4b990-d415-4c4d-9f58-f24777c1558d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.194248 May 27 09:39:44.167761 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9092ee1a-fa38-432d-8fb5-e277f6d62152 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.216923 May 27 09:39:44.168088 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 169/327] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:43 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:44.169271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 159/328] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:43 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:44.466718 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d174b1bd-10d7-49ba-8f33-281ce64de927 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:44.467747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d174b1bd-10d7-49ba-8f33-281ce64de927 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:44.478944 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d174b1bd-10d7-49ba-8f33-281ce64de927 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:44.479748 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d174b1bd-10d7-49ba-8f33-281ce64de927 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:44.481098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d174b1bd-10d7-49ba-8f33-281ce64de927 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:44.481850 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d174b1bd-10d7-49ba-8f33-281ce64de927 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:44.649520 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d174b1bd-10d7-49ba-8f33-281ce64de927 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:44.661472 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d174b1bd-10d7-49ba-8f33-281ce64de927 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.202438 May 27 09:39:44.662680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 170/329] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:44 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:44.888575 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-cb55c9d9-0aca-4a50-9e74-d3b800cd6624 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:44.890864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-cb55c9d9-0aca-4a50-9e74-d3b800cd6624 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:44.897741 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb55c9d9-0aca-4a50-9e74-d3b800cd6624 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:44.898213 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb55c9d9-0aca-4a50-9e74-d3b800cd6624 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:44.899332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb55c9d9-0aca-4a50-9e74-d3b800cd6624 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:44.899769 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb55c9d9-0aca-4a50-9e74-d3b800cd6624 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.049795 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cb55c9d9-0aca-4a50-9e74-d3b800cd6624 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.058557 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-cb55c9d9-0aca-4a50-9e74-d3b800cd6624 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1502 microversion: 2.1 time: 0.174326 May 27 09:39:45.059765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 160/330] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:44 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:45.082572 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7273376c-406f-443e-bdc3-b58c7671ca09 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "073768b3-cfce-4c5a-9923-fa9e8911588f"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:45.084816 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7273376c-406f-443e-bdc3-b58c7671ca09 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:45.096193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7273376c-406f-443e-bdc3-b58c7671ca09 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.097125 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7273376c-406f-443e-bdc3-b58c7671ca09 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.098634 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7273376c-406f-443e-bdc3-b58c7671ca09 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.099278 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7273376c-406f-443e-bdc3-b58c7671ca09 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.123780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-7273376c-406f-443e-bdc3-b58c7671ca09 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] HTTP exception thrown: Cannot 'attach_volume' instance 1f3d6419-841c-47ae-8564-c770ed395103 while it is in vm_state rescued May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7273376c-406f-443e-bdc3-b58c7671ca09 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Request method failure captured: May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: POST /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103/os-volume_attachments HTTP/1.1 May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 74 May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJvuSI5jHOqY2C1Tp2SCsB1rovkIRjm2wJf4hz65RNutH_SPrQoDBkvp0GnBa3AUQB1hA-TWNGKN5vDSdhd3DdQEXVS7iqHQ-4OVc0ILrDoxM-uFCx9uwEsold8dkXD1jI6-jlu--3Znf24skIggPZiAjJ6EEkZ7sKpSagXNJ2tfeoI May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 91f6b3c676a84127989cc8e35ce91de1 May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:39:45.125598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91f6b3c676a84127989cc8e35ce91de1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 91f6b3c676a84127989cc8e35ce91de1 May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-ServerRescueNegativeTestJSON-916011391-project May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 5132dcb5580d44e1bc2c7cf4a6893678 May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-ServerRescueNegativeTestJSON-916011391-project May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {"volumeAttachment": {"volumeId": "073768b3-cfce-4c5a-9923-fa9e8911588f"}} May 27 09:39:45.127532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Cannot 'attach_volume' instance 1f3d6419-841c-47ae-8564-c770ed395103 while it is in vm_state rescued May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'server_id': '1f3d6419-841c-47ae-8564-c770ed395103', 'body': {'volumeAttachment': {'volumeId': '073768b3-cfce-4c5a-9923-fa9e8911588f'}}} May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1f3d6419-841c-47ae-8564-c770ed395103 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:39:45.128476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 1f3d6419-841c-47ae-8564-c770ed395103 while it is in vm_state rescued May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:39:45.129828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:39:45.133946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:39:45.133946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:39:45.133946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 1f3d6419-841c-47ae-8564-c770ed395103 while it is in vm_state rescued May 27 09:39:45.133946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:39:45.133946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7273376c-406f-443e-bdc3-b58c7671ca09 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Returning 409 to user: Cannot 'attach_volume' instance 1f3d6419-841c-47ae-8564-c770ed395103 while it is in vm_state rescued {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:39:45.133946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7273376c-406f-443e-bdc3-b58c7671ca09 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.054198 May 27 09:39:45.133946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 171/331] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:39:45 2022] POST /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103/os-volume_attachments => generated 152 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 09:39:45.139078 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c658d027-9529-4b7b-b50e-48eba4f99594 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:45.139583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c658d027-9529-4b7b-b50e-48eba4f99594 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:45.145955 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c658d027-9529-4b7b-b50e-48eba4f99594 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.146445 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c658d027-9529-4b7b-b50e-48eba4f99594 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.147224 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c658d027-9529-4b7b-b50e-48eba4f99594 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.147665 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c658d027-9529-4b7b-b50e-48eba4f99594 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.187170 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-25142bd2-f45d-4d10-a637-06bd8c7ab749 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:45.187821 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-25142bd2-f45d-4d10-a637-06bd8c7ab749 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:45.194947 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-25142bd2-f45d-4d10-a637-06bd8c7ab749 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.195437 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-25142bd2-f45d-4d10-a637-06bd8c7ab749 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.196192 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-25142bd2-f45d-4d10-a637-06bd8c7ab749 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.196629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-25142bd2-f45d-4d10-a637-06bd8c7ab749 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.346578 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-25142bd2-f45d-4d10-a637-06bd8c7ab749 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.355127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-25142bd2-f45d-4d10-a637-06bd8c7ab749 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.357158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-25142bd2-f45d-4d10-a637-06bd8c7ab749 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.358462 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-25142bd2-f45d-4d10-a637-06bd8c7ab749 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.175888 May 27 09:39:45.359033 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 172/332] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:45 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:45.363559 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-30e62f6f-bdda-4fb9-a739-05944d58f215 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:45.364157 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-30e62f6f-bdda-4fb9-a739-05944d58f215 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:45.370618 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30e62f6f-bdda-4fb9-a739-05944d58f215 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.371065 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30e62f6f-bdda-4fb9-a739-05944d58f215 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.372423 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30e62f6f-bdda-4fb9-a739-05944d58f215 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.372962 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30e62f6f-bdda-4fb9-a739-05944d58f215 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.514937 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-30e62f6f-bdda-4fb9-a739-05944d58f215 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.515860 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c658d027-9529-4b7b-b50e-48eba4f99594 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103/action" status: 202 len: 0 microversion: 2.1 time: 0.382122 May 27 09:39:45.516967 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 161/333] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:39:45 2022] POST /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:39:45.524672 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-30e62f6f-bdda-4fb9-a739-05944d58f215 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.164551 May 27 09:39:45.525520 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 173/334] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:45 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:45.528090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ca8d21eb-4252-4586-9206-e24af51316ac tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:45.528853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ca8d21eb-4252-4586-9206-e24af51316ac tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:45.535401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca8d21eb-4252-4586-9206-e24af51316ac tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.535966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca8d21eb-4252-4586-9206-e24af51316ac tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.536752 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca8d21eb-4252-4586-9206-e24af51316ac tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.537179 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca8d21eb-4252-4586-9206-e24af51316ac tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.685301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b866043a-197b-4c0e-bedf-f57d691304bb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:45.686067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b866043a-197b-4c0e-bedf-f57d691304bb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:45.692738 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b866043a-197b-4c0e-bedf-f57d691304bb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.693193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b866043a-197b-4c0e-bedf-f57d691304bb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.693979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b866043a-197b-4c0e-bedf-f57d691304bb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:45.694450 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b866043a-197b-4c0e-bedf-f57d691304bb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:45.698868 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ca8d21eb-4252-4586-9206-e24af51316ac tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.712496 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ca8d21eb-4252-4586-9206-e24af51316ac tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.188699 May 27 09:39:45.713448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 162/335] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:45 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:45.840884 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b866043a-197b-4c0e-bedf-f57d691304bb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:45.849045 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b866043a-197b-4c0e-bedf-f57d691304bb tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.168811 May 27 09:39:45.849646 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 174/336] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:45 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:46.379378 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bf7e2527-edae-4c1f-88d4-b475e7366282 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:46.380353 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bf7e2527-edae-4c1f-88d4-b475e7366282 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:46.389630 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bf7e2527-edae-4c1f-88d4-b475e7366282 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.390392 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bf7e2527-edae-4c1f-88d4-b475e7366282 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.391705 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bf7e2527-edae-4c1f-88d4-b475e7366282 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.392263 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bf7e2527-edae-4c1f-88d4-b475e7366282 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.556008 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-fe455b15-94f6-4723-afbb-19afbe711900 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:46.556862 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-fe455b15-94f6-4723-afbb-19afbe711900 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:46.571374 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe455b15-94f6-4723-afbb-19afbe711900 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.572917 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe455b15-94f6-4723-afbb-19afbe711900 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.573781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe455b15-94f6-4723-afbb-19afbe711900 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.574468 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe455b15-94f6-4723-afbb-19afbe711900 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.667485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bf7e2527-edae-4c1f-88d4-b475e7366282 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:46.677908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bf7e2527-edae-4c1f-88d4-b475e7366282 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:46.679693 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bf7e2527-edae-4c1f-88d4-b475e7366282 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:46.680991 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bf7e2527-edae-4c1f-88d4-b475e7366282 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.307113 May 27 09:39:46.681628 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 163/337] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:46 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:46.740437 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bec0cc81-9c7c-47df-9ea2-0f15e90775b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:46.741160 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bec0cc81-9c7c-47df-9ea2-0f15e90775b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:46.746889 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fe455b15-94f6-4723-afbb-19afbe711900 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:46.748371 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bec0cc81-9c7c-47df-9ea2-0f15e90775b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.748828 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bec0cc81-9c7c-47df-9ea2-0f15e90775b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.749643 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bec0cc81-9c7c-47df-9ea2-0f15e90775b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.750242 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bec0cc81-9c7c-47df-9ea2-0f15e90775b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.756157 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-fe455b15-94f6-4723-afbb-19afbe711900 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.214745 May 27 09:39:46.757050 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 175/338] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:46 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:46.872765 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c045068c-b919-4e44-bba9-e4cbe6fe140e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:46.873443 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c045068c-b919-4e44-bba9-e4cbe6fe140e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:46.882431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c045068c-b919-4e44-bba9-e4cbe6fe140e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.882926 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c045068c-b919-4e44-bba9-e4cbe6fe140e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.883889 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c045068c-b919-4e44-bba9-e4cbe6fe140e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:46.884325 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c045068c-b919-4e44-bba9-e4cbe6fe140e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:46.909489 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bec0cc81-9c7c-47df-9ea2-0f15e90775b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:46.918931 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bec0cc81-9c7c-47df-9ea2-0f15e90775b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.182452 May 27 09:39:46.919517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 164/339] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:46 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:47.049128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c045068c-b919-4e44-bba9-e4cbe6fe140e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:47.062945 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c045068c-b919-4e44-bba9-e4cbe6fe140e tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.195905 May 27 09:39:47.063630 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 176/340] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:46 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:47.701052 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bd8bc41e-1428-444c-907c-3cc013881807 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:47.701671 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bd8bc41e-1428-444c-907c-3cc013881807 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:47.708543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bd8bc41e-1428-444c-907c-3cc013881807 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:47.708999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bd8bc41e-1428-444c-907c-3cc013881807 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:47.709780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bd8bc41e-1428-444c-907c-3cc013881807 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:47.710245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bd8bc41e-1428-444c-907c-3cc013881807 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:47.777339 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d8edeac7-56f0-4e06-937e-d5100b0ab504 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:47.778710 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d8edeac7-56f0-4e06-937e-d5100b0ab504 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:47.788794 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d8edeac7-56f0-4e06-937e-d5100b0ab504 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:47.788794 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d8edeac7-56f0-4e06-937e-d5100b0ab504 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:47.790469 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d8edeac7-56f0-4e06-937e-d5100b0ab504 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:47.790931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d8edeac7-56f0-4e06-937e-d5100b0ab504 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:47.864708 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bd8bc41e-1428-444c-907c-3cc013881807 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:47.877661 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bd8bc41e-1428-444c-907c-3cc013881807 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:47.879618 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bd8bc41e-1428-444c-907c-3cc013881807 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:47.880813 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bd8bc41e-1428-444c-907c-3cc013881807 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.183765 May 27 09:39:47.881455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 165/341] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:47 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:47.941341 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f71e137b-8f5b-44b9-aac7-ef174f9d1445 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:47.942081 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f71e137b-8f5b-44b9-aac7-ef174f9d1445 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:47.950186 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f71e137b-8f5b-44b9-aac7-ef174f9d1445 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:47.950765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f71e137b-8f5b-44b9-aac7-ef174f9d1445 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:47.951626 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f71e137b-8f5b-44b9-aac7-ef174f9d1445 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:47.952157 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f71e137b-8f5b-44b9-aac7-ef174f9d1445 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:47.980192 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d8edeac7-56f0-4e06-937e-d5100b0ab504 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:47.988778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d8edeac7-56f0-4e06-937e-d5100b0ab504 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.215693 May 27 09:39:47.989351 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 177/342] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:47 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:48.084263 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0bbae1ce-3fb6-49f1-98b9-d938548f00c3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:48.084911 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0bbae1ce-3fb6-49f1-98b9-d938548f00c3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:48.091494 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0bbae1ce-3fb6-49f1-98b9-d938548f00c3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:48.091952 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0bbae1ce-3fb6-49f1-98b9-d938548f00c3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:48.092788 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0bbae1ce-3fb6-49f1-98b9-d938548f00c3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:48.093220 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0bbae1ce-3fb6-49f1-98b9-d938548f00c3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:48.099725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f71e137b-8f5b-44b9-aac7-ef174f9d1445 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:48.107755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f71e137b-8f5b-44b9-aac7-ef174f9d1445 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.170830 May 27 09:39:48.115869 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 166/343] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:47 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:48.235687 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0bbae1ce-3fb6-49f1-98b9-d938548f00c3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:48.245962 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0bbae1ce-3fb6-49f1-98b9-d938548f00c3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.168146 May 27 09:39:48.247216 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 178/344] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:48 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:48.899748 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ed74927c-32e5-4dde-8e5d-ce000943ef28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:48.900302 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ed74927c-32e5-4dde-8e5d-ce000943ef28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:48.907542 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ed74927c-32e5-4dde-8e5d-ce000943ef28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:48.909092 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ed74927c-32e5-4dde-8e5d-ce000943ef28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:48.909092 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ed74927c-32e5-4dde-8e5d-ce000943ef28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:48.909277 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ed74927c-32e5-4dde-8e5d-ce000943ef28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.007861 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d5201e18-598e-4001-b29f-8e2addd3aee8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:49.008718 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d5201e18-598e-4001-b29f-8e2addd3aee8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:49.015813 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d5201e18-598e-4001-b29f-8e2addd3aee8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.016252 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d5201e18-598e-4001-b29f-8e2addd3aee8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.017035 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d5201e18-598e-4001-b29f-8e2addd3aee8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.017463 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d5201e18-598e-4001-b29f-8e2addd3aee8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.104011 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ed74927c-32e5-4dde-8e5d-ce000943ef28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.113216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ed74927c-32e5-4dde-8e5d-ce000943ef28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.114715 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ed74927c-32e5-4dde-8e5d-ce000943ef28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.115996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ed74927c-32e5-4dde-8e5d-ce000943ef28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.220214 May 27 09:39:49.116559 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 167/345] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:48 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:49.124851 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6cef2046-5fca-42c0-a385-a7beef7c3deb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:49.125572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6cef2046-5fca-42c0-a385-a7beef7c3deb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:49.132321 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6cef2046-5fca-42c0-a385-a7beef7c3deb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.132765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6cef2046-5fca-42c0-a385-a7beef7c3deb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.133545 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6cef2046-5fca-42c0-a385-a7beef7c3deb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.133980 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6cef2046-5fca-42c0-a385-a7beef7c3deb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.166330 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d5201e18-598e-4001-b29f-8e2addd3aee8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.175482 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d5201e18-598e-4001-b29f-8e2addd3aee8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.171099 May 27 09:39:49.176253 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 179/346] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:49 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:49.264858 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-dbb7b3b3-e86a-42e4-8258-125ff83b0b50 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:49.265473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-dbb7b3b3-e86a-42e4-8258-125ff83b0b50 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:49.272084 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dbb7b3b3-e86a-42e4-8258-125ff83b0b50 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.272539 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dbb7b3b3-e86a-42e4-8258-125ff83b0b50 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.273308 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dbb7b3b3-e86a-42e4-8258-125ff83b0b50 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:49.273741 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dbb7b3b3-e86a-42e4-8258-125ff83b0b50 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:49.291214 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6cef2046-5fca-42c0-a385-a7beef7c3deb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.301286 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6cef2046-5fca-42c0-a385-a7beef7c3deb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.178826 May 27 09:39:49.301932 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 168/347] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:49 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:49.437457 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-dbb7b3b3-e86a-42e4-8258-125ff83b0b50 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:49.445484 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-dbb7b3b3-e86a-42e4-8258-125ff83b0b50 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.185118 May 27 09:39:49.446059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 180/348] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:49 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:50.134753 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1df5401b-2f64-4203-9fc2-a22f3aae4299 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:50.135381 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1df5401b-2f64-4203-9fc2-a22f3aae4299 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:50.142440 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1df5401b-2f64-4203-9fc2-a22f3aae4299 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.142889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1df5401b-2f64-4203-9fc2-a22f3aae4299 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.143668 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1df5401b-2f64-4203-9fc2-a22f3aae4299 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.144106 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1df5401b-2f64-4203-9fc2-a22f3aae4299 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.192597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9e53c2ae-ebf1-4c78-b69f-b2efe1b79714 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:50.193428 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9e53c2ae-ebf1-4c78-b69f-b2efe1b79714 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:50.200514 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9e53c2ae-ebf1-4c78-b69f-b2efe1b79714 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.200963 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9e53c2ae-ebf1-4c78-b69f-b2efe1b79714 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.201746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9e53c2ae-ebf1-4c78-b69f-b2efe1b79714 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.202179 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9e53c2ae-ebf1-4c78-b69f-b2efe1b79714 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.293154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1df5401b-2f64-4203-9fc2-a22f3aae4299 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.310012 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1df5401b-2f64-4203-9fc2-a22f3aae4299 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.310012 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1df5401b-2f64-4203-9fc2-a22f3aae4299 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.310012 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1df5401b-2f64-4203-9fc2-a22f3aae4299 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.174427 May 27 09:39:50.310314 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 169/349] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:50 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:50.318815 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-baf9858b-6b49-4f63-b3a7-0d88f5f8197b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:50.319433 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-baf9858b-6b49-4f63-b3a7-0d88f5f8197b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:50.325523 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-baf9858b-6b49-4f63-b3a7-0d88f5f8197b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.326118 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-baf9858b-6b49-4f63-b3a7-0d88f5f8197b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.326999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-baf9858b-6b49-4f63-b3a7-0d88f5f8197b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.327434 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-baf9858b-6b49-4f63-b3a7-0d88f5f8197b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.359515 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9e53c2ae-ebf1-4c78-b69f-b2efe1b79714 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.370829 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9e53c2ae-ebf1-4c78-b69f-b2efe1b79714 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.180976 May 27 09:39:50.370829 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 181/350] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:50 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:50.466407 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-baf9858b-6b49-4f63-b3a7-0d88f5f8197b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.471349 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c32463ce-54f6-41b6-9952-559f8898105a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:50.472480 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c32463ce-54f6-41b6-9952-559f8898105a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:50.474668 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-baf9858b-6b49-4f63-b3a7-0d88f5f8197b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.159567 May 27 09:39:50.475304 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 170/351] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:50 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:50.483663 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c32463ce-54f6-41b6-9952-559f8898105a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.484291 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c32463ce-54f6-41b6-9952-559f8898105a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.485266 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c32463ce-54f6-41b6-9952-559f8898105a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:50.485988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c32463ce-54f6-41b6-9952-559f8898105a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:50.638609 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c32463ce-54f6-41b6-9952-559f8898105a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:50.648159 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c32463ce-54f6-41b6-9952-559f8898105a tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.184811 May 27 09:39:50.648934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 182/352] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:50 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:51.324574 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f3e013ce-0dd2-4d77-8fe5-3cdb47b9c703 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:51.325392 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f3e013ce-0dd2-4d77-8fe5-3cdb47b9c703 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:51.332231 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f3e013ce-0dd2-4d77-8fe5-3cdb47b9c703 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.332683 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f3e013ce-0dd2-4d77-8fe5-3cdb47b9c703 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.333455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f3e013ce-0dd2-4d77-8fe5-3cdb47b9c703 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.333888 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f3e013ce-0dd2-4d77-8fe5-3cdb47b9c703 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.337182 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:51.389315 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-dfdb4181-f957-41e5-bba9-89e2179c9dd1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:51.390040 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-dfdb4181-f957-41e5-bba9-89e2179c9dd1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:51.397272 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dfdb4181-f957-41e5-bba9-89e2179c9dd1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.397724 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dfdb4181-f957-41e5-bba9-89e2179c9dd1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.400135 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dfdb4181-f957-41e5-bba9-89e2179c9dd1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.400135 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dfdb4181-f957-41e5-bba9-89e2179c9dd1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.508086 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f3e013ce-0dd2-4d77-8fe5-3cdb47b9c703 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.522596 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f3e013ce-0dd2-4d77-8fe5-3cdb47b9c703 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.525768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f3e013ce-0dd2-4d77-8fe5-3cdb47b9c703 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.528108 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f3e013ce-0dd2-4d77-8fe5-3cdb47b9c703 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.207259 May 27 09:39:51.529019 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 171/353] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:51 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:51.538559 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-98bc24c0-13a3-429e-ac68-606b733fcb63 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:51.538853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-98bc24c0-13a3-429e-ac68-606b733fcb63 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:51.552555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-98bc24c0-13a3-429e-ac68-606b733fcb63 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.553335 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-98bc24c0-13a3-429e-ac68-606b733fcb63 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.554803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-98bc24c0-13a3-429e-ac68-606b733fcb63 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.555653 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-98bc24c0-13a3-429e-ac68-606b733fcb63 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.584493 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-dfdb4181-f957-41e5-bba9-89e2179c9dd1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.597064 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-dfdb4181-f957-41e5-bba9-89e2179c9dd1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.212231 May 27 09:39:51.597972 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 183/354] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:51 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:51.666391 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-fb86799e-8610-42be-b1c2-0674cad4d5ea tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:51.667009 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-fb86799e-8610-42be-b1c2-0674cad4d5ea tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:51.673588 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fb86799e-8610-42be-b1c2-0674cad4d5ea tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.674030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fb86799e-8610-42be-b1c2-0674cad4d5ea tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.674838 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fb86799e-8610-42be-b1c2-0674cad4d5ea tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:51.675285 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fb86799e-8610-42be-b1c2-0674cad4d5ea tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:51.679874 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=100 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:51.708565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-98bc24c0-13a3-429e-ac68-606b733fcb63 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.716841 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-98bc24c0-13a3-429e-ac68-606b733fcb63 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.186317 May 27 09:39:51.717452 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 172/355] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:51 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:51.815786 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fb86799e-8610-42be-b1c2-0674cad4d5ea tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:51.824553 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-fb86799e-8610-42be-b1c2-0674cad4d5ea tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.162199 May 27 09:39:51.825241 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 184/356] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:51 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:52.547974 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4a3c9d76-88d4-466f-8111-d58908ad2f39 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:52.549281 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4a3c9d76-88d4-466f-8111-d58908ad2f39 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:52.556625 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4a3c9d76-88d4-466f-8111-d58908ad2f39 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.557095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4a3c9d76-88d4-466f-8111-d58908ad2f39 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.557860 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4a3c9d76-88d4-466f-8111-d58908ad2f39 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.558345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4a3c9d76-88d4-466f-8111-d58908ad2f39 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.626019 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e2734ff5-358c-4663-9f6d-87ef0532faa8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:52.627320 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e2734ff5-358c-4663-9f6d-87ef0532faa8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:52.636473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e2734ff5-358c-4663-9f6d-87ef0532faa8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.637037 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e2734ff5-358c-4663-9f6d-87ef0532faa8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.637931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e2734ff5-358c-4663-9f6d-87ef0532faa8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.638468 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e2734ff5-358c-4663-9f6d-87ef0532faa8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.712184 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4a3c9d76-88d4-466f-8111-d58908ad2f39 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:52.727001 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4a3c9d76-88d4-466f-8111-d58908ad2f39 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:52.728597 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4a3c9d76-88d4-466f-8111-d58908ad2f39 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:52.729802 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4a3c9d76-88d4-466f-8111-d58908ad2f39 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.185849 May 27 09:39:52.730385 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 173/357] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:52 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:52.735891 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f7104f57-f037-4c94-bcdd-3e2be5bd7444 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:52.737130 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f7104f57-f037-4c94-bcdd-3e2be5bd7444 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:52.742799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f7104f57-f037-4c94-bcdd-3e2be5bd7444 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.743318 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f7104f57-f037-4c94-bcdd-3e2be5bd7444 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.744214 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f7104f57-f037-4c94-bcdd-3e2be5bd7444 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.744649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f7104f57-f037-4c94-bcdd-3e2be5bd7444 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.813901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e2734ff5-358c-4663-9f6d-87ef0532faa8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:52.822181 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e2734ff5-358c-4663-9f6d-87ef0532faa8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.203807 May 27 09:39:52.822797 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 185/358] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:52 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:52.845416 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ec490058-6a4e-47ea-a08d-cc535072447b tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:52.846033 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ec490058-6a4e-47ea-a08d-cc535072447b tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:52.852401 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ec490058-6a4e-47ea-a08d-cc535072447b tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.852854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ec490058-6a4e-47ea-a08d-cc535072447b tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.853638 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ec490058-6a4e-47ea-a08d-cc535072447b tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:52.854080 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ec490058-6a4e-47ea-a08d-cc535072447b tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:52.896871 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f7104f57-f037-4c94-bcdd-3e2be5bd7444 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:52.905734 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f7104f57-f037-4c94-bcdd-3e2be5bd7444 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.173588 May 27 09:39:52.906775 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 174/359] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:52 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:53.031489 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ec490058-6a4e-47ea-a08d-cc535072447b tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:53.039417 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ec490058-6a4e-47ea-a08d-cc535072447b tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1505 microversion: 2.1 time: 0.197788 May 27 09:39:53.039993 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 186/360] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:52 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1505 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:53.202070 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-53d30be1-ee95-4100-b244-2314cd490ef4 req-25250ea2-884a-41ea-b551-1383edc616b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00493c7-512d-4e39-b167-46c08ea1b09f", "name": "network-vif-unplugged", "status": "completed", "tag": "dc18c36f-6816-4b30-a079-e9e595c82af4"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:53.213348 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-53d30be1-ee95-4100-b244-2314cd490ef4 req-25250ea2-884a-41ea-b551-1383edc616b5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:53.213348 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-53d30be1-ee95-4100-b244-2314cd490ef4 req-25250ea2-884a-41ea-b551-1383edc616b5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:53.228260 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-53d30be1-ee95-4100-b244-2314cd490ef4 req-25250ea2-884a-41ea-b551-1383edc616b5 service nova] Creating event network-vif-unplugged:dc18c36f-6816-4b30-a079-e9e595c82af4 for instance a00493c7-512d-4e39-b167-46c08ea1b09f on hv-cinder-82549 May 27 09:39:53.234538 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-53d30be1-ee95-4100-b244-2314cd490ef4 req-25250ea2-884a-41ea-b551-1383edc616b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039569 May 27 09:39:53.235664 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 175/361] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:53.750565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-32ae01af-9b56-40ee-8075-fc17e6f43698 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:53.751193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-32ae01af-9b56-40ee-8075-fc17e6f43698 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:53.758113 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-32ae01af-9b56-40ee-8075-fc17e6f43698 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:53.758605 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-32ae01af-9b56-40ee-8075-fc17e6f43698 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:53.759391 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-32ae01af-9b56-40ee-8075-fc17e6f43698 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:53.759831 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-32ae01af-9b56-40ee-8075-fc17e6f43698 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:53.843116 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-8d7feb6f-d26f-42ee-b854-93830c82803c req-ecc2be8e-d09e-4c55-8821-8f002c955a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a00493c7-512d-4e39-b167-46c08ea1b09f", "name": "network-vif-deleted", "tag": "dc18c36f-6816-4b30-a079-e9e595c82af4"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:39:53.858874 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-8d7feb6f-d26f-42ee-b854-93830c82803c req-ecc2be8e-d09e-4c55-8821-8f002c955a44 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:53.859326 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-8d7feb6f-d26f-42ee-b854-93830c82803c req-ecc2be8e-d09e-4c55-8821-8f002c955a44 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:53.870882 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-8d7feb6f-d26f-42ee-b854-93830c82803c req-ecc2be8e-d09e-4c55-8821-8f002c955a44 service nova] Creating event network-vif-deleted:dc18c36f-6816-4b30-a079-e9e595c82af4 for instance a00493c7-512d-4e39-b167-46c08ea1b09f on hv-cinder-82549 May 27 09:39:53.889789 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-8d7feb6f-d26f-42ee-b854-93830c82803c req-ecc2be8e-d09e-4c55-8821-8f002c955a44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053151 May 27 09:39:53.890999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 176/362] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:39:53.895857 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b6219a24-3e06-45c7-af18-4698f7e11b74 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:53.896563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b6219a24-3e06-45c7-af18-4698f7e11b74 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:53.903832 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b6219a24-3e06-45c7-af18-4698f7e11b74 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:53.904282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b6219a24-3e06-45c7-af18-4698f7e11b74 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:53.905051 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b6219a24-3e06-45c7-af18-4698f7e11b74 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:53.905482 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b6219a24-3e06-45c7-af18-4698f7e11b74 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:53.943172 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-32ae01af-9b56-40ee-8075-fc17e6f43698 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:53.951662 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-32ae01af-9b56-40ee-8075-fc17e6f43698 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:53.953268 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-32ae01af-9b56-40ee-8075-fc17e6f43698 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:53.954544 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-32ae01af-9b56-40ee-8075-fc17e6f43698 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.209143 May 27 09:39:53.955482 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 187/363] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:53 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:53.959795 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f19ec61a-3866-4258-b906-b9eeca45f404 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:53.960392 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f19ec61a-3866-4258-b906-b9eeca45f404 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:53.966819 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f19ec61a-3866-4258-b906-b9eeca45f404 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:53.967330 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f19ec61a-3866-4258-b906-b9eeca45f404 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:53.968186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f19ec61a-3866-4258-b906-b9eeca45f404 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:53.968690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f19ec61a-3866-4258-b906-b9eeca45f404 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:54.046519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b6219a24-3e06-45c7-af18-4698f7e11b74 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:54.055845 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b6219a24-3e06-45c7-af18-4698f7e11b74 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.164051 May 27 09:39:54.056432 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 177/364] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:53 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:54.061218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1b3bb0ee-4c00-4f5a-afc2-67f362ef86dc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:54.070387 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1b3bb0ee-4c00-4f5a-afc2-67f362ef86dc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:54.070387 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b3bb0ee-4c00-4f5a-afc2-67f362ef86dc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.070387 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b3bb0ee-4c00-4f5a-afc2-67f362ef86dc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:54.070387 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b3bb0ee-4c00-4f5a-afc2-67f362ef86dc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.073167 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1b3bb0ee-4c00-4f5a-afc2-67f362ef86dc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:54.123452 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f19ec61a-3866-4258-b906-b9eeca45f404 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:54.132206 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f19ec61a-3866-4258-b906-b9eeca45f404 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.175586 May 27 09:39:54.142102 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 188/365] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:53 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:54.145173 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1b3bb0ee-4c00-4f5a-afc2-67f362ef86dc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:54.154790 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1b3bb0ee-4c00-4f5a-afc2-67f362ef86dc tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1463 microversion: 2.1 time: 0.097264 May 27 09:39:54.155644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 178/366] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:54 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1463 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:54.892641 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:39:54.893311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 09:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:39:54.976855 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e10fb851-f331-4e94-a2b0-154533b07283 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:54.977766 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e10fb851-f331-4e94-a2b0-154533b07283 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:54.988337 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e10fb851-f331-4e94-a2b0-154533b07283 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.988869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e10fb851-f331-4e94-a2b0-154533b07283 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:54.990225 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e10fb851-f331-4e94-a2b0-154533b07283 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:54.990738 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e10fb851-f331-4e94-a2b0-154533b07283 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.054899 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:39:55.055159 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 09:39:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca (ip 10.222.0.48) !!! May 27 09:39:55.073257 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8b3c9610-2836-45ab-8746-a427848a03a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:55.073904 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8b3c9610-2836-45ab-8746-a427848a03a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:55.081934 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b3c9610-2836-45ab-8746-a427848a03a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.083156 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b3c9610-2836-45ab-8746-a427848a03a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.083156 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b3c9610-2836-45ab-8746-a427848a03a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.083509 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b3c9610-2836-45ab-8746-a427848a03a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.169847 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e10fb851-f331-4e94-a2b0-154533b07283 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:55.183068 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e10fb851-f331-4e94-a2b0-154533b07283 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:55.185211 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e10fb851-f331-4e94-a2b0-154533b07283 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:55.186449 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e10fb851-f331-4e94-a2b0-154533b07283 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.215958 May 27 09:39:55.187031 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 189/367] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:54 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:55.191808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f4768e71-e9e2-4a97-a7a6-c74fe6b4d2d3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:55.192427 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f4768e71-e9e2-4a97-a7a6-c74fe6b4d2d3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:55.199127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f4768e71-e9e2-4a97-a7a6-c74fe6b4d2d3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.199632 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f4768e71-e9e2-4a97-a7a6-c74fe6b4d2d3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.200468 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f4768e71-e9e2-4a97-a7a6-c74fe6b4d2d3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.201060 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f4768e71-e9e2-4a97-a7a6-c74fe6b4d2d3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.237008 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8b3c9610-2836-45ab-8746-a427848a03a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:55.247016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8b3c9610-2836-45ab-8746-a427848a03a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.176975 May 27 09:39:55.247912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 179/368] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:55 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:55.260987 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:55.261601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:55.269540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.270469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.271491 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.272081 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.310657 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:55.311204 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:55.311752 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lazy-loading 'fault' on Instance uuid a00493c7-512d-4e39-b167-46c08ea1b09f {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:39:55.358766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:55.363815 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f4768e71-e9e2-4a97-a7a6-c74fe6b4d2d3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:55.367500 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f22e22cd-6b09-4349-8414-5337311a77ab tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1304 microversion: 2.1 time: 0.118740 May 27 09:39:55.368089 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 180/369] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:55 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:55.375125 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f4768e71-e9e2-4a97-a7a6-c74fe6b4d2d3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.187038 May 27 09:39:55.375795 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 190/370] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:55 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:56.205760 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8a0c1d54-9f5d-44db-92fb-3e9eb5cf66b1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:56.206518 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8a0c1d54-9f5d-44db-92fb-3e9eb5cf66b1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:56.212969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8a0c1d54-9f5d-44db-92fb-3e9eb5cf66b1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.213422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8a0c1d54-9f5d-44db-92fb-3e9eb5cf66b1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.214223 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8a0c1d54-9f5d-44db-92fb-3e9eb5cf66b1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.214657 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8a0c1d54-9f5d-44db-92fb-3e9eb5cf66b1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.265881 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5051b249-611a-49ac-a1c3-4f6dd18b2d67 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:56.266740 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5051b249-611a-49ac-a1c3-4f6dd18b2d67 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:56.277883 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5051b249-611a-49ac-a1c3-4f6dd18b2d67 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.278711 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5051b249-611a-49ac-a1c3-4f6dd18b2d67 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.279976 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5051b249-611a-49ac-a1c3-4f6dd18b2d67 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.280689 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5051b249-611a-49ac-a1c3-4f6dd18b2d67 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.379045 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8a0c1d54-9f5d-44db-92fb-3e9eb5cf66b1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.388378 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8a0c1d54-9f5d-44db-92fb-3e9eb5cf66b1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.389927 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8a0c1d54-9f5d-44db-92fb-3e9eb5cf66b1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.391731 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8a0c1d54-9f5d-44db-92fb-3e9eb5cf66b1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.189523 May 27 09:39:56.391731 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 181/371] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:56 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:56.396315 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c18dc6df-3477-4af7-b144-5c90feb75e3c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:56.396931 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c18dc6df-3477-4af7-b144-5c90feb75e3c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:56.403514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c18dc6df-3477-4af7-b144-5c90feb75e3c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.403962 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c18dc6df-3477-4af7-b144-5c90feb75e3c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.404743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c18dc6df-3477-4af7-b144-5c90feb75e3c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.405410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c18dc6df-3477-4af7-b144-5c90feb75e3c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.476938 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5051b249-611a-49ac-a1c3-4f6dd18b2d67 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.490022 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5051b249-611a-49ac-a1c3-4f6dd18b2d67 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.228914 May 27 09:39:56.490695 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 191/372] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:56 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:39:56.495582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:56.497218 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:56.504075 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.504529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.505309 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.505746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.540650 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:56.541268 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:56.541841 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lazy-loading 'fault' on Instance uuid a00493c7-512d-4e39-b167-46c08ea1b09f {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:39:56.559127 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c18dc6df-3477-4af7-b144-5c90feb75e3c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.568093 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c18dc6df-3477-4af7-b144-5c90feb75e3c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.175303 May 27 09:39:56.568886 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 182/373] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:56 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:56.591561 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:56.607617 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ad66dd23-7b6e-483c-bd5c-5a5f3dcf36f1 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1304 microversion: 2.1 time: 0.115843 May 27 09:39:56.608212 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 192/374] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:56 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:57.411667 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a0b68fef-8020-4682-a86e-2f33a1165784 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:57.412413 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a0b68fef-8020-4682-a86e-2f33a1165784 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:57.424730 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a0b68fef-8020-4682-a86e-2f33a1165784 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.424730 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a0b68fef-8020-4682-a86e-2f33a1165784 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.424730 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a0b68fef-8020-4682-a86e-2f33a1165784 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.424730 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a0b68fef-8020-4682-a86e-2f33a1165784 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.509613 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-364ebe57-a01a-4bcf-85f1-848228872156 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:57.510527 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-364ebe57-a01a-4bcf-85f1-848228872156 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:57.518072 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-364ebe57-a01a-4bcf-85f1-848228872156 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.518557 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-364ebe57-a01a-4bcf-85f1-848228872156 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.519361 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-364ebe57-a01a-4bcf-85f1-848228872156 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.519804 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-364ebe57-a01a-4bcf-85f1-848228872156 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.628235 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a0b68fef-8020-4682-a86e-2f33a1165784 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.637712 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a0b68fef-8020-4682-a86e-2f33a1165784 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.639459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a0b68fef-8020-4682-a86e-2f33a1165784 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.640786 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a0b68fef-8020-4682-a86e-2f33a1165784 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.233378 May 27 09:39:57.641437 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 183/375] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:57 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:57.651525 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d5417e04-d31d-4521-8611-b27e00f7f564 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:57.651525 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d5417e04-d31d-4521-8611-b27e00f7f564 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:57.654351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5417e04-d31d-4521-8611-b27e00f7f564 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.655065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5417e04-d31d-4521-8611-b27e00f7f564 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.655926 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5417e04-d31d-4521-8611-b27e00f7f564 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.656423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5417e04-d31d-4521-8611-b27e00f7f564 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.685249 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-364ebe57-a01a-4bcf-85f1-848228872156 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.696006 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-364ebe57-a01a-4bcf-85f1-848228872156 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.190312 May 27 09:39:57.696603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 193/376] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:57 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:57.702082 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:57.702744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:57.709560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.710233 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.711035 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.711477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.757426 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:57.758339 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:57.759369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lazy-loading 'fault' on Instance uuid a00493c7-512d-4e39-b167-46c08ea1b09f {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:39:57.816526 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.823828 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d5417e04-d31d-4521-8611-b27e00f7f564 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:57.826111 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ca2eca14-4e0d-43ae-a043-3f171923adf4 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1304 microversion: 2.1 time: 0.128432 May 27 09:39:57.826768 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 194/377] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:57 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:57.836027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d5417e04-d31d-4521-8611-b27e00f7f564 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.193270 May 27 09:39:57.836911 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 184/378] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:57 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:58.671611 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8572768f-606b-406d-8e1c-a8f8c15fbb93 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:58.672254 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8572768f-606b-406d-8e1c-a8f8c15fbb93 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:58.674735 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=100 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:58.679926 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8572768f-606b-406d-8e1c-a8f8c15fbb93 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.680371 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8572768f-606b-406d-8e1c-a8f8c15fbb93 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.681206 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8572768f-606b-406d-8e1c-a8f8c15fbb93 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.681657 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8572768f-606b-406d-8e1c-a8f8c15fbb93 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.722122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4ebc5d8c-17e1-4321-892c-0c0676fe05e5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:58.723679 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4ebc5d8c-17e1-4321-892c-0c0676fe05e5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:58.726263 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:39:58.732415 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4ebc5d8c-17e1-4321-892c-0c0676fe05e5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.732882 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4ebc5d8c-17e1-4321-892c-0c0676fe05e5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.733649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4ebc5d8c-17e1-4321-892c-0c0676fe05e5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.734081 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4ebc5d8c-17e1-4321-892c-0c0676fe05e5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.904178 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8572768f-606b-406d-8e1c-a8f8c15fbb93 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:58.918110 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8572768f-606b-406d-8e1c-a8f8c15fbb93 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:58.920697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8572768f-606b-406d-8e1c-a8f8c15fbb93 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:58.922565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8572768f-606b-406d-8e1c-a8f8c15fbb93 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.256268 May 27 09:39:58.923391 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 195/379] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:58 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:39:58.930980 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:58.932202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:58.941768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4ebc5d8c-17e1-4321-892c-0c0676fe05e5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:58.943078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.944007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.945082 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.945641 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.952636 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4ebc5d8c-17e1-4321-892c-0c0676fe05e5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.237226 May 27 09:39:58.953702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 185/380] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:58 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:58.964129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f373e31c-4982-4153-b0ad-918a13eb4bf9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:58.966493 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f373e31c-4982-4153-b0ad-918a13eb4bf9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:58.976179 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f373e31c-4982-4153-b0ad-918a13eb4bf9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.976788 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f373e31c-4982-4153-b0ad-918a13eb4bf9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.977792 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f373e31c-4982-4153-b0ad-918a13eb4bf9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.978416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f373e31c-4982-4153-b0ad-918a13eb4bf9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.994564 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:58.995242 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:58.995909 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lazy-loading 'fault' on Instance uuid a00493c7-512d-4e39-b167-46c08ea1b09f {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:39:59.049105 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:59.063324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-474a3bff-3705-44c5-97b4-1cb012afe745 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1304 microversion: 2.1 time: 0.137976 May 27 09:39:59.064373 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 196/381] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:58 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:59.177751 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f373e31c-4982-4153-b0ad-918a13eb4bf9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:39:59.187728 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f373e31c-4982-4153-b0ad-918a13eb4bf9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.232483 May 27 09:39:59.188326 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 186/382] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:58 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:39:59.945052 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2182ac50-ce95-473d-ab35-bf8e48fdae4c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:59.945683 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2182ac50-ce95-473d-ab35-bf8e48fdae4c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:59.952896 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2182ac50-ce95-473d-ab35-bf8e48fdae4c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:59.953346 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2182ac50-ce95-473d-ab35-bf8e48fdae4c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:59.954247 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2182ac50-ce95-473d-ab35-bf8e48fdae4c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:59.954692 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2182ac50-ce95-473d-ab35-bf8e48fdae4c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:59.979924 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c9242f8b-7079-4a2e-9f34-80a8beb8b3c3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:39:59.981174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c9242f8b-7079-4a2e-9f34-80a8beb8b3c3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:39:59.988015 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c9242f8b-7079-4a2e-9f34-80a8beb8b3c3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:59.988457 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c9242f8b-7079-4a2e-9f34-80a8beb8b3c3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:39:59.989242 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c9242f8b-7079-4a2e-9f34-80a8beb8b3c3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:39:59.989747 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c9242f8b-7079-4a2e-9f34-80a8beb8b3c3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.163516 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c9242f8b-7079-4a2e-9f34-80a8beb8b3c3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.176470 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c9242f8b-7079-4a2e-9f34-80a8beb8b3c3 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.200319 May 27 09:40:00.177631 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 187/383] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:39:59 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:00.184776 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:00.185525 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:00.195331 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.196334 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.197576 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.198024 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.239197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.239673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.240122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lazy-loading 'fault' on Instance uuid a00493c7-512d-4e39-b167-46c08ea1b09f {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:40:00.241812 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=100 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:00.285299 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.293255 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3bb46c61-aa81-45f1-bcfc-5481ea3b6e25 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1304 microversion: 2.1 time: 0.114280 May 27 09:40:00.293837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 188/384] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:00 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:00.298412 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-eba14b8d-35ca-4208-a183-4ff84e945181 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:00.299021 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-eba14b8d-35ca-4208-a183-4ff84e945181 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:00.305605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eba14b8d-35ca-4208-a183-4ff84e945181 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.306047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eba14b8d-35ca-4208-a183-4ff84e945181 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.306850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eba14b8d-35ca-4208-a183-4ff84e945181 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:00.307279 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eba14b8d-35ca-4208-a183-4ff84e945181 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:00.332278 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2182ac50-ce95-473d-ab35-bf8e48fdae4c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.342907 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2182ac50-ce95-473d-ab35-bf8e48fdae4c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.344424 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2182ac50-ce95-473d-ab35-bf8e48fdae4c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.345691 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2182ac50-ce95-473d-ab35-bf8e48fdae4c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.405095 May 27 09:40:00.346184 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 197/385] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:39:59 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:00.452873 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-eba14b8d-35ca-4208-a183-4ff84e945181 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:00.465945 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-eba14b8d-35ca-4208-a183-4ff84e945181 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.170911 May 27 09:40:00.466766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 189/386] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:00 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:01.197622 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d1bee01a-f009-4580-9c62-072ec6fa82c2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:01.198183 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d1bee01a-f009-4580-9c62-072ec6fa82c2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:01.205229 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d1bee01a-f009-4580-9c62-072ec6fa82c2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.205692 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d1bee01a-f009-4580-9c62-072ec6fa82c2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.206515 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d1bee01a-f009-4580-9c62-072ec6fa82c2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.206984 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d1bee01a-f009-4580-9c62-072ec6fa82c2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.314739 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:01.315855 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:01.327522 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.328332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.329623 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.330500 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.387624 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d1bee01a-f009-4580-9c62-072ec6fa82c2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:01.394010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.394010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.394010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lazy-loading 'fault' on Instance uuid a00493c7-512d-4e39-b167-46c08ea1b09f {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:40:01.398122 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d1bee01a-f009-4580-9c62-072ec6fa82c2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.204365 May 27 09:40:01.398859 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 198/387] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:01 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:01.407060 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-15855d6d-4907-4071-8772-0b813000ff5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:01.408162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-15855d6d-4907-4071-8772-0b813000ff5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:01.419670 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-15855d6d-4907-4071-8772-0b813000ff5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.420397 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-15855d6d-4907-4071-8772-0b813000ff5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.421425 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-15855d6d-4907-4071-8772-0b813000ff5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.422009 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-15855d6d-4907-4071-8772-0b813000ff5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.448492 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:01.458500 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-dfe43ace-d9b1-4b55-baf1-56587f86fddf tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1304 microversion: 2.1 time: 0.151360 May 27 09:40:01.459200 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 190/388] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:01 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:01.496088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f3220944-9f9b-437e-86b4-fe5154b02254 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:01.497471 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f3220944-9f9b-437e-86b4-fe5154b02254 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:01.508850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f3220944-9f9b-437e-86b4-fe5154b02254 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.509679 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f3220944-9f9b-437e-86b4-fe5154b02254 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.511149 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f3220944-9f9b-437e-86b4-fe5154b02254 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:01.511974 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f3220944-9f9b-437e-86b4-fe5154b02254 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:01.618274 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-15855d6d-4907-4071-8772-0b813000ff5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:01.620926 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=100 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:01.627738 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-15855d6d-4907-4071-8772-0b813000ff5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:01.629379 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-15855d6d-4907-4071-8772-0b813000ff5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:01.635387 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-15855d6d-4907-4071-8772-0b813000ff5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.230326 May 27 09:40:01.635387 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 199/389] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:01 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:01.689129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f3220944-9f9b-437e-86b4-fe5154b02254 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:01.702058 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f3220944-9f9b-437e-86b4-fe5154b02254 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.213225 May 27 09:40:01.702855 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 191/390] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:01 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:02.425203 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8358c5f0-1765-4ed5-8232-0bfe62d4a64d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:02.425940 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8358c5f0-1765-4ed5-8232-0bfe62d4a64d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:02.434308 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8358c5f0-1765-4ed5-8232-0bfe62d4a64d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.434758 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8358c5f0-1765-4ed5-8232-0bfe62d4a64d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.435545 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8358c5f0-1765-4ed5-8232-0bfe62d4a64d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.435996 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8358c5f0-1765-4ed5-8232-0bfe62d4a64d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.476924 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:02.477599 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:02.484650 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.485187 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.486758 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.487428 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.548577 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.550457 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.551051 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lazy-loading 'fault' on Instance uuid a00493c7-512d-4e39-b167-46c08ea1b09f {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:40:02.616678 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:02.625566 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-76fd36c4-80da-4035-bc33-85654faf8685 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1304 microversion: 2.1 time: 0.152592 May 27 09:40:02.626177 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 192/391] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:02 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:02.638640 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8358c5f0-1765-4ed5-8232-0bfe62d4a64d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:02.648945 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8358c5f0-1765-4ed5-8232-0bfe62d4a64d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.227725 May 27 09:40:02.649803 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 200/392] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:02 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:02.664117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c2b7c38a-1cfe-4172-94a3-342116bfd5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:02.665429 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c2b7c38a-1cfe-4172-94a3-342116bfd5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:02.673239 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c2b7c38a-1cfe-4172-94a3-342116bfd5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.673686 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c2b7c38a-1cfe-4172-94a3-342116bfd5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.674533 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c2b7c38a-1cfe-4172-94a3-342116bfd5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.674968 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c2b7c38a-1cfe-4172-94a3-342116bfd5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.732160 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9a6f5ab0-306c-4836-a220-3f8601e10448 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:02.733084 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9a6f5ab0-306c-4836-a220-3f8601e10448 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:02.744243 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9a6f5ab0-306c-4836-a220-3f8601e10448 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.744934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9a6f5ab0-306c-4836-a220-3f8601e10448 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.747143 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9a6f5ab0-306c-4836-a220-3f8601e10448 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:02.747927 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9a6f5ab0-306c-4836-a220-3f8601e10448 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:02.843331 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c2b7c38a-1cfe-4172-94a3-342116bfd5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:02.858911 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c2b7c38a-1cfe-4172-94a3-342116bfd5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:02.862321 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c2b7c38a-1cfe-4172-94a3-342116bfd5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:02.864491 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c2b7c38a-1cfe-4172-94a3-342116bfd5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.207793 May 27 09:40:02.865527 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 193/393] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:02 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:02.968007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9a6f5ab0-306c-4836-a220-3f8601e10448 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:02.976189 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9a6f5ab0-306c-4836-a220-3f8601e10448 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.252833 May 27 09:40:02.976794 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 201/394] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:02 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:03.611351 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:40:03.611947 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 09:40:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:40:03.647378 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:03.648067 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:03.656203 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.656688 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.657446 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.657883 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.675612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4bbe62ce-e4fa-4700-879b-955c2d9ef573 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:03.676317 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4bbe62ce-e4fa-4700-879b-955c2d9ef573 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:03.685294 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4bbe62ce-e4fa-4700-879b-955c2d9ef573 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.685736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4bbe62ce-e4fa-4700-879b-955c2d9ef573 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.686694 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4bbe62ce-e4fa-4700-879b-955c2d9ef573 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.687304 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4bbe62ce-e4fa-4700-879b-955c2d9ef573 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.697000 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.697728 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.698496 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lazy-loading 'fault' on Instance uuid a00493c7-512d-4e39-b167-46c08ea1b09f {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:40:03.763640 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:03.772115 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-002b5d06-74ed-4c76-bcc7-83da426c2ea6 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1304 microversion: 2.1 time: 0.128480 May 27 09:40:03.773004 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 194/395] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:03 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1304 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:03.840387 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4bbe62ce-e4fa-4700-879b-955c2d9ef573 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:03.851692 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4bbe62ce-e4fa-4700-879b-955c2d9ef573 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.179943 May 27 09:40:03.852727 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 202/396] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:03 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:03.893371 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fd8480bb-7490-432e-a3f9-a36d2717b8aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:03.894216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fd8480bb-7490-432e-a3f9-a36d2717b8aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:03.902090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd8480bb-7490-432e-a3f9-a36d2717b8aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.903222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd8480bb-7490-432e-a3f9-a36d2717b8aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.904043 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd8480bb-7490-432e-a3f9-a36d2717b8aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:03.904483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd8480bb-7490-432e-a3f9-a36d2717b8aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:03.998923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-19b0895a-ab9c-4eeb-84bf-4c9dd722c8e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:04.000047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-19b0895a-ab9c-4eeb-84bf-4c9dd722c8e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:04.010955 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19b0895a-ab9c-4eeb-84bf-4c9dd722c8e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.011694 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19b0895a-ab9c-4eeb-84bf-4c9dd722c8e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.013182 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19b0895a-ab9c-4eeb-84bf-4c9dd722c8e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.013909 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19b0895a-ab9c-4eeb-84bf-4c9dd722c8e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.068222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fd8480bb-7490-432e-a3f9-a36d2717b8aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:04.077534 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fd8480bb-7490-432e-a3f9-a36d2717b8aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:04.079119 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fd8480bb-7490-432e-a3f9-a36d2717b8aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:04.080341 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fd8480bb-7490-432e-a3f9-a36d2717b8aa tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.192587 May 27 09:40:04.080919 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 195/397] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:03 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:04.192813 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-19b0895a-ab9c-4eeb-84bf-4c9dd722c8e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:04.205848 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-19b0895a-ab9c-4eeb-84bf-4c9dd722c8e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1510 microversion: 2.1 time: 0.214397 May 27 09:40:04.206660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 203/398] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:03 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:04.792206 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:04.793058 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:04.799915 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.800365 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.801152 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.801601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.847919 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.848949 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.849987 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lazy-loading 'fault' on Instance uuid a00493c7-512d-4e39-b167-46c08ea1b09f {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:40:04.871307 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c8942953-6e17-4758-a743-775218103399 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:04.872841 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c8942953-6e17-4758-a743-775218103399 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:04.881491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c8942953-6e17-4758-a743-775218103399 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.882377 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c8942953-6e17-4758-a743-775218103399 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.883861 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c8942953-6e17-4758-a743-775218103399 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:04.884769 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c8942953-6e17-4758-a743-775218103399 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:04.921261 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c853e08893d741a9993289a223d2fbca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '313701a0b7184376946ba96a22c05ad1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:04.929996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b2788d74-2bf3-449f-858c-d35029fede66 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 200 len: 1304 microversion: 2.1 time: 0.142155 May 27 09:40:04.930733 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 196/399] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:04 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:05.070715 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c8942953-6e17-4758-a743-775218103399 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:05.080506 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c8942953-6e17-4758-a743-775218103399 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.213030 May 27 09:40:05.080980 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 204/400] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:04 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:05.110712 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6fb9c548-5285-4e88-98a7-7addbdcf75d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:05.111586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6fb9c548-5285-4e88-98a7-7addbdcf75d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:05.119707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6fb9c548-5285-4e88-98a7-7addbdcf75d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:05.125122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6fb9c548-5285-4e88-98a7-7addbdcf75d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:05.125122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6fb9c548-5285-4e88-98a7-7addbdcf75d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:05.125122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6fb9c548-5285-4e88-98a7-7addbdcf75d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:05.224941 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-04584797-51fd-4853-b6a5-b04d5db6616d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:05.225929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-04584797-51fd-4853-b6a5-b04d5db6616d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:05.234877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-04584797-51fd-4853-b6a5-b04d5db6616d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:05.235426 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-04584797-51fd-4853-b6a5-b04d5db6616d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:05.236176 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-04584797-51fd-4853-b6a5-b04d5db6616d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:05.236948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-04584797-51fd-4853-b6a5-b04d5db6616d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:05.340841 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6fb9c548-5285-4e88-98a7-7addbdcf75d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:05.359682 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6fb9c548-5285-4e88-98a7-7addbdcf75d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:05.363172 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6fb9c548-5285-4e88-98a7-7addbdcf75d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:05.365692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6fb9c548-5285-4e88-98a7-7addbdcf75d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.259376 May 27 09:40:05.367179 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 197/401] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:05 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:40:05.439977 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-04584797-51fd-4853-b6a5-b04d5db6616d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:05.449121 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-04584797-51fd-4853-b6a5-b04d5db6616d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1516 microversion: 2.1 time: 0.228461 May 27 09:40:05.463476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 205/402] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:05 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1516 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:05.948011 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4968e2f7-8b5c-4cbf-9852-387b163080d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:05.948633 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4968e2f7-8b5c-4cbf-9852-387b163080d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] [instance: a00493c7-512d-4e39-b167-46c08ea1b09f] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:05.955776 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4968e2f7-8b5c-4cbf-9852-387b163080d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:05.956369 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4968e2f7-8b5c-4cbf-9852-387b163080d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:05.957152 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4968e2f7-8b5c-4cbf-9852-387b163080d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:05.957592 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4968e2f7-8b5c-4cbf-9852-387b163080d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:05.975843 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-4968e2f7-8b5c-4cbf-9852-387b163080d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] HTTP exception thrown: Instance a00493c7-512d-4e39-b167-46c08ea1b09f could not be found. May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4968e2f7-8b5c-4cbf-9852-387b163080d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Request method failure captured: May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f HTTP/1.1 May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJwXfUI6AWqelTQFYZqdHEACK-2dyDG_OO8XwoCCxvgsBrC5X2MjlcE3gUs349LtW1s4Xeutj5JPZTxdIpoMmoNzozBC5JEwaRJipUqKSS7_vg12DJLo4GfAZzf44cn7nU2QhGcP_RBQYTfE123MRX8TSlpbQLV713_bB7laPVHM4iw May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 313701a0b7184376946ba96a22c05ad1 May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-VolumesActionsTest-2002656217 May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:40:05.977767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/313701a0b7184376946ba96a22c05ad1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/313701a0b7184376946ba96a22c05ad1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/313701a0b7184376946ba96a22c05ad1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_313701a0b7184376946ba96a22c05ad1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-VolumesActionsTest-2002656217 May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 313701a0b7184376946ba96a22c05ad1 May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-VolumesActionsTest-2002656217 May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-VolumesActionsTest-2002656217-project May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: c853e08893d741a9993289a223d2fbca May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-VolumesActionsTest-2002656217-project May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance a00493c7-512d-4e39-b167-46c08ea1b09f could not be found. May 27 09:40:05.979205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': 'a00493c7-512d-4e39-b167-46c08ea1b09f'} May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a00493c7-512d-4e39-b167-46c08ea1b09f could not be found. May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:40:05.980047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a00493c7-512d-4e39-b167-46c08ea1b09f could not be found. May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a00493c7-512d-4e39-b167-46c08ea1b09f could not be found. May 27 09:40:05.982088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:40:05.983423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4968e2f7-8b5c-4cbf-9852-387b163080d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] Returning 404 to user: Instance a00493c7-512d-4e39-b167-46c08ea1b09f could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:40:05.983423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4968e2f7-8b5c-4cbf-9852-387b163080d3 tempest-VolumesActionsTest-2002656217 tempest-VolumesActionsTest-2002656217-project] 10.222.0.48 "GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f" status: 404 len: 111 microversion: 2.1 time: 0.035192 May 27 09:40:05.983423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 198/403] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:05 2022] GET /compute/v2.1/servers/a00493c7-512d-4e39-b167-46c08ea1b09f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 09:40:06.100703 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-fcf0798b-7817-4f49-9200-0de3fdb01478 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:06.101419 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-fcf0798b-7817-4f49-9200-0de3fdb01478 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:06.112548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fcf0798b-7817-4f49-9200-0de3fdb01478 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.113292 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fcf0798b-7817-4f49-9200-0de3fdb01478 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.114425 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fcf0798b-7817-4f49-9200-0de3fdb01478 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.115148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fcf0798b-7817-4f49-9200-0de3fdb01478 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.304704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fcf0798b-7817-4f49-9200-0de3fdb01478 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:06.313573 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-fcf0798b-7817-4f49-9200-0de3fdb01478 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.218199 May 27 09:40:06.314154 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 206/404] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:06 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:06.395722 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c9df41be-9c68-4b08-9649-34ab4d6939f0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:06.396657 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c9df41be-9c68-4b08-9649-34ab4d6939f0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:06.405726 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c9df41be-9c68-4b08-9649-34ab4d6939f0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.405726 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c9df41be-9c68-4b08-9649-34ab4d6939f0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.406053 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c9df41be-9c68-4b08-9649-34ab4d6939f0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:06.406478 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c9df41be-9c68-4b08-9649-34ab4d6939f0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:06.603528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c9df41be-9c68-4b08-9649-34ab4d6939f0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:06.613726 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c9df41be-9c68-4b08-9649-34ab4d6939f0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:06.617955 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c9df41be-9c68-4b08-9649-34ab4d6939f0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:06.617955 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c9df41be-9c68-4b08-9649-34ab4d6939f0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.225584 May 27 09:40:06.617955 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 199/405] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:06 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:07.336953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-916dfa3f-bd01-4a9c-aa78-d024c47ae5db tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:07.337724 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-916dfa3f-bd01-4a9c-aa78-d024c47ae5db tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:07.348673 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-916dfa3f-bd01-4a9c-aa78-d024c47ae5db tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:07.349280 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-916dfa3f-bd01-4a9c-aa78-d024c47ae5db tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:07.350318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-916dfa3f-bd01-4a9c-aa78-d024c47ae5db tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:07.350833 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-916dfa3f-bd01-4a9c-aa78-d024c47ae5db tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:07.539872 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-916dfa3f-bd01-4a9c-aa78-d024c47ae5db tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:07.553475 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-916dfa3f-bd01-4a9c-aa78-d024c47ae5db tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.221049 May 27 09:40:07.554529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 207/406] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:07 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:07.640784 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9c80fd58-241c-454a-a70d-b477d8349964 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:07.641827 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9c80fd58-241c-454a-a70d-b477d8349964 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:07.650243 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c80fd58-241c-454a-a70d-b477d8349964 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:07.651287 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c80fd58-241c-454a-a70d-b477d8349964 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:07.658137 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c80fd58-241c-454a-a70d-b477d8349964 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:07.658137 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c80fd58-241c-454a-a70d-b477d8349964 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:07.830590 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9c80fd58-241c-454a-a70d-b477d8349964 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:07.839031 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9c80fd58-241c-454a-a70d-b477d8349964 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:07.841053 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9c80fd58-241c-454a-a70d-b477d8349964 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:07.842266 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9c80fd58-241c-454a-a70d-b477d8349964 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.209011 May 27 09:40:07.842826 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 200/407] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:07 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:08.579656 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3d10cb79-7bd4-4a04-ad9f-a80b793b8d65 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:08.580492 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3d10cb79-7bd4-4a04-ad9f-a80b793b8d65 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:08.589166 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3d10cb79-7bd4-4a04-ad9f-a80b793b8d65 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:08.609115 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3d10cb79-7bd4-4a04-ad9f-a80b793b8d65 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:08.609115 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3d10cb79-7bd4-4a04-ad9f-a80b793b8d65 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:08.609115 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3d10cb79-7bd4-4a04-ad9f-a80b793b8d65 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:08.775497 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ba77c65a-7917-4205-b096-8e807d6e843d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'create', calling method: .version_select at 0x7fbe3269b0d0>, body: {"keypair": {"name": "tempest-keypair-1527290638", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWQAJzXH8ZgIzcu17uKsVoEd10/nCpzGN3KFBxsJkcJchpCr57T8Se4rPAZqY/mrZJIhZO0/7IMlPowlk2M3pVVRdj/98qiFF/iLUM0JhXCA0csJZ5/50fKC0JCvifpwg=="}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:08.790902 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-ba77c65a-7917-4205-b096-8e807d6e843d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Getting quotas for project 91f6b3c676a84127989cc8e35ce91de1. Resources: {'key_pairs'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:40:08.795284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-ba77c65a-7917-4205-b096-8e807d6e843d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Getting quotas for user 5132dcb5580d44e1bc2c7cf4a6893678 and project 91f6b3c676a84127989cc8e35ce91de1. Resources: {'key_pairs'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:40:08.811230 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3d10cb79-7bd4-4a04-ad9f-a80b793b8d65 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:08.830027 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3d10cb79-7bd4-4a04-ad9f-a80b793b8d65 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.255916 May 27 09:40:08.830648 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 208/408] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:08 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:08.861667 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4d7a024e-995c-42be-b68b-7e2ac408a1d2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:08.862307 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4d7a024e-995c-42be-b68b-7e2ac408a1d2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:08.868804 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4d7a024e-995c-42be-b68b-7e2ac408a1d2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:08.869248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4d7a024e-995c-42be-b68b-7e2ac408a1d2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:08.870018 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4d7a024e-995c-42be-b68b-7e2ac408a1d2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:08.870492 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4d7a024e-995c-42be-b68b-7e2ac408a1d2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:08.955158 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ba77c65a-7917-4205-b096-8e807d6e843d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183204 May 27 09:40:08.955807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 201/409] 10.222.0.48 () {60 vars in 1158 bytes} [Fri May 27 09:40:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:40:09.042771 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4d7a024e-995c-42be-b68b-7e2ac408a1d2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:09.052574 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4d7a024e-995c-42be-b68b-7e2ac408a1d2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:09.054064 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4d7a024e-995c-42be-b68b-7e2ac408a1d2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:09.055263 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4d7a024e-995c-42be-b68b-7e2ac408a1d2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.197928 May 27 09:40:09.055821 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 209/410] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:08 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:40:09.856929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6219578f-e0ae-4dfc-98a8-47087c22e012 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:09.860182 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6219578f-e0ae-4dfc-98a8-47087c22e012 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:09.869546 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6219578f-e0ae-4dfc-98a8-47087c22e012 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.870083 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6219578f-e0ae-4dfc-98a8-47087c22e012 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:09.871111 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6219578f-e0ae-4dfc-98a8-47087c22e012 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:09.871683 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6219578f-e0ae-4dfc-98a8-47087c22e012 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:10.032411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6219578f-e0ae-4dfc-98a8-47087c22e012 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:10.041121 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6219578f-e0ae-4dfc-98a8-47087c22e012 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.193303 May 27 09:40:10.041826 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 202/411] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:09 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:10.076727 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-52c1362e-4aa1-4b90-af78-04fdf34ecda0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:10.077348 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-52c1362e-4aa1-4b90-af78-04fdf34ecda0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:10.084656 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-52c1362e-4aa1-4b90-af78-04fdf34ecda0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:10.085117 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-52c1362e-4aa1-4b90-af78-04fdf34ecda0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:10.087134 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-52c1362e-4aa1-4b90-af78-04fdf34ecda0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:10.087134 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-52c1362e-4aa1-4b90-af78-04fdf34ecda0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:10.278377 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-52c1362e-4aa1-4b90-af78-04fdf34ecda0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:10.286965 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-52c1362e-4aa1-4b90-af78-04fdf34ecda0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:10.288487 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-52c1362e-4aa1-4b90-af78-04fdf34ecda0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:10.289656 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-52c1362e-4aa1-4b90-af78-04fdf34ecda0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.217048 May 27 09:40:10.290244 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 210/412] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:10 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:11.061262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a5dadc0a-b037-47c3-ab20-0ccb7bce3dd2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:11.062337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a5dadc0a-b037-47c3-ab20-0ccb7bce3dd2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:11.070295 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a5dadc0a-b037-47c3-ab20-0ccb7bce3dd2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:11.070946 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a5dadc0a-b037-47c3-ab20-0ccb7bce3dd2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:11.072159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a5dadc0a-b037-47c3-ab20-0ccb7bce3dd2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:11.072954 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a5dadc0a-b037-47c3-ab20-0ccb7bce3dd2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:11.281119 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a5dadc0a-b037-47c3-ab20-0ccb7bce3dd2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:11.295200 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a5dadc0a-b037-47c3-ab20-0ccb7bce3dd2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.238487 May 27 09:40:11.296180 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 203/413] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:11 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:11.318671 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e343b0ae-e90e-40b8-9321-7e1150287758 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:11.325368 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e343b0ae-e90e-40b8-9321-7e1150287758 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:11.327746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e343b0ae-e90e-40b8-9321-7e1150287758 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:11.328208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e343b0ae-e90e-40b8-9321-7e1150287758 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:11.329003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e343b0ae-e90e-40b8-9321-7e1150287758 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:11.329442 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e343b0ae-e90e-40b8-9321-7e1150287758 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:11.559143 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e343b0ae-e90e-40b8-9321-7e1150287758 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:11.573547 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e343b0ae-e90e-40b8-9321-7e1150287758 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:11.576122 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e343b0ae-e90e-40b8-9321-7e1150287758 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:11.577361 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e343b0ae-e90e-40b8-9321-7e1150287758 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.269741 May 27 09:40:11.578277 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 211/414] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:11 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:12.329774 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-434f01ca-cea0-4d76-bbf6-1dfc07c66fa6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:12.330985 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-434f01ca-cea0-4d76-bbf6-1dfc07c66fa6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:12.340718 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-434f01ca-cea0-4d76-bbf6-1dfc07c66fa6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:12.341313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-434f01ca-cea0-4d76-bbf6-1dfc07c66fa6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:12.342336 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-434f01ca-cea0-4d76-bbf6-1dfc07c66fa6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:12.342868 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-434f01ca-cea0-4d76-bbf6-1dfc07c66fa6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:12.539488 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-434f01ca-cea0-4d76-bbf6-1dfc07c66fa6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:12.550743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-434f01ca-cea0-4d76-bbf6-1dfc07c66fa6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1722 microversion: 2.1 time: 0.228245 May 27 09:40:12.551716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 204/415] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:12 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:12.602504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a710ef6d-0f8d-4c73-9e08-2510d46dc3e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:12.604942 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a710ef6d-0f8d-4c73-9e08-2510d46dc3e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:12.616519 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a710ef6d-0f8d-4c73-9e08-2510d46dc3e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:12.619058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a710ef6d-0f8d-4c73-9e08-2510d46dc3e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:12.620228 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a710ef6d-0f8d-4c73-9e08-2510d46dc3e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:12.620931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a710ef6d-0f8d-4c73-9e08-2510d46dc3e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:12.644932 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1954390613", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "486123a6-d792-4300-8761-0207c83d70db"}], "security_groups": [{"name": "tempest-securitygroup--1530898313"}], "key_name": "tempest-keypair-1527290638", "user_data": "}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:12.787117 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a710ef6d-0f8d-4c73-9e08-2510d46dc3e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:12.803171 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a710ef6d-0f8d-4c73-9e08-2510d46dc3e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:12.805936 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] validate_networks() for [('486123a6-d792-4300-8761-0207c83d70db', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:40:12.806113 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a710ef6d-0f8d-4c73-9e08-2510d46dc3e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:12.808091 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a710ef6d-0f8d-4c73-9e08-2510d46dc3e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.214604 May 27 09:40:12.809078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 212/416] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:12 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:13.513353 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:40:13.513853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:40:13.514435 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:40:13.514894 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:40:13.515372 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:40:13.527551 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.528002 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.528823 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.529264 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.549067 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Getting quotas for project 91f6b3c676a84127989cc8e35ce91de1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:40:13.554171 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Getting quotas for user 5132dcb5580d44e1bc2c7cf4a6893678 and project 91f6b3c676a84127989cc8e35ce91de1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:40:13.567881 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:40:13.570260 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:40:13.573341 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-35d92a54-b087-4a41-bc88-94e2c0b440ed tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:13.574538 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-35d92a54-b087-4a41-bc88-94e2c0b440ed tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:13.585823 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-35d92a54-b087-4a41-bc88-94e2c0b440ed tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.586665 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-35d92a54-b087-4a41-bc88-94e2c0b440ed tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.588109 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-35d92a54-b087-4a41-bc88-94e2c0b440ed tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.588962 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-35d92a54-b087-4a41-bc88-94e2c0b440ed tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.775703 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-35d92a54-b087-4a41-bc88-94e2c0b440ed tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:13.785579 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-35d92a54-b087-4a41-bc88-94e2c0b440ed tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1699 microversion: 2.1 time: 0.219990 May 27 09:40:13.790035 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 213/417] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:13 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1699 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:13.804176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d1c50b94-1277-4c73-a40e-eedbbf71f20e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.167669 May 27 09:40:13.805348 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 205/418] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:40:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 09:40:13.807024 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-39850c14-ecad-4d2d-9bb6-937c2c96668d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:13.814257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-39850c14-ecad-4d2d-9bb6-937c2c96668d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.814719 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-39850c14-ecad-4d2d-9bb6-937c2c96668d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.820368 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-07caa119-517e-4578-a807-c9f21e9224c8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:13.821872 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-07caa119-517e-4578-a807-c9f21e9224c8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:13.897827 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-39850c14-ecad-4d2d-9bb6-937c2c96668d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Going to try to start instance {{(pid=124829) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 09:40:13.905665 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-07caa119-517e-4578-a807-c9f21e9224c8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:13.913381 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-07caa119-517e-4578-a807-c9f21e9224c8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1246 microversion: 2.1 time: 0.100863 May 27 09:40:13.914766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 206/419] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:13 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:13.919876 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8fc179c4-1c3b-416b-b3aa-f2ade01b5dee tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:13.920760 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8fc179c4-1c3b-416b-b3aa-f2ade01b5dee tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:13.928144 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8fc179c4-1c3b-416b-b3aa-f2ade01b5dee tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.928596 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8fc179c4-1c3b-416b-b3aa-f2ade01b5dee tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.930274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8fc179c4-1c3b-416b-b3aa-f2ade01b5dee tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:13.930721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8fc179c4-1c3b-416b-b3aa-f2ade01b5dee tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:13.935693 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=100 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:14.132779 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8fc179c4-1c3b-416b-b3aa-f2ade01b5dee tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:14.147779 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8fc179c4-1c3b-416b-b3aa-f2ade01b5dee tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:14.147956 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-39850c14-ecad-4d2d-9bb6-937c2c96668d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/action" status: 202 len: 0 microversion: 2.1 time: 0.341937 May 27 09:40:14.147956 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 214/420] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:40:13 2022] POST /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 09:40:14.148131 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8fc179c4-1c3b-416b-b3aa-f2ade01b5dee tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:14.148131 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8fc179c4-1c3b-416b-b3aa-f2ade01b5dee tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.231236 May 27 09:40:14.148687 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 207/421] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:13 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:14.165919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-625d6122-5d87-4c87-ba45-12e9886236a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:14.166826 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-625d6122-5d87-4c87-ba45-12e9886236a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:14.173963 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-625d6122-5d87-4c87-ba45-12e9886236a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:14.174541 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-625d6122-5d87-4c87-ba45-12e9886236a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:14.175324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-625d6122-5d87-4c87-ba45-12e9886236a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:14.176353 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-625d6122-5d87-4c87-ba45-12e9886236a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:14.193625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:14.400380 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-625d6122-5d87-4c87-ba45-12e9886236a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:14.426771 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-625d6122-5d87-4c87-ba45-12e9886236a5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1708 microversion: 2.1 time: 0.264974 May 27 09:40:14.428121 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 215/422] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:14 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1708 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:14.948583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-065c1820-26a7-45ee-879f-88436fe6ab02 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:14.952424 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-065c1820-26a7-45ee-879f-88436fe6ab02 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:15.091954 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-065c1820-26a7-45ee-879f-88436fe6ab02 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:15.110395 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-065c1820-26a7-45ee-879f-88436fe6ab02 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1246 microversion: 2.1 time: 0.180248 May 27 09:40:15.111778 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 208/423] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:14 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1246 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:15.177363 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7a6c7abd-3cc8-4f82-9623-23b0ada852c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:15.178855 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7a6c7abd-3cc8-4f82-9623-23b0ada852c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:15.201961 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7a6c7abd-3cc8-4f82-9623-23b0ada852c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:15.203722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7a6c7abd-3cc8-4f82-9623-23b0ada852c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:15.206099 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7a6c7abd-3cc8-4f82-9623-23b0ada852c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:15.206900 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7a6c7abd-3cc8-4f82-9623-23b0ada852c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:15.467052 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fba1c3be-56c0-46cd-b2a1-1a279c704d1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:15.468568 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fba1c3be-56c0-46cd-b2a1-1a279c704d1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:15.494664 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fba1c3be-56c0-46cd-b2a1-1a279c704d1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:15.498109 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fba1c3be-56c0-46cd-b2a1-1a279c704d1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:15.500662 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fba1c3be-56c0-46cd-b2a1-1a279c704d1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:15.502962 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fba1c3be-56c0-46cd-b2a1-1a279c704d1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:15.512531 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7a6c7abd-3cc8-4f82-9623-23b0ada852c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:15.553420 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7a6c7abd-3cc8-4f82-9623-23b0ada852c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:15.566675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7a6c7abd-3cc8-4f82-9623-23b0ada852c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:15.578239 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7a6c7abd-3cc8-4f82-9623-23b0ada852c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1744 microversion: 2.20 time: 0.402786 May 27 09:40:15.599370 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 216/424] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:15 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1744 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:15.830352 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fba1c3be-56c0-46cd-b2a1-1a279c704d1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:15.845822 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fba1c3be-56c0-46cd-b2a1-1a279c704d1c tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1708 microversion: 2.1 time: 0.397343 May 27 09:40:15.846474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 209/425] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:15 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1708 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:16.135683 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c781ad73-2d33-484e-9e39-982151f99819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:16.137597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c781ad73-2d33-484e-9e39-982151f99819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:16.144350 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c781ad73-2d33-484e-9e39-982151f99819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.144523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c781ad73-2d33-484e-9e39-982151f99819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.145257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c781ad73-2d33-484e-9e39-982151f99819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.147168 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c781ad73-2d33-484e-9e39-982151f99819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.297808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c781ad73-2d33-484e-9e39-982151f99819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:16.311566 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c781ad73-2d33-484e-9e39-982151f99819 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1242 microversion: 2.1 time: 0.176515 May 27 09:40:16.312636 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 217/426] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:16 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1242 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:16.612218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7456790b-5301-45e0-919f-e10b6b2bc274 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:16.613097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7456790b-5301-45e0-919f-e10b6b2bc274 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:16.639238 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7456790b-5301-45e0-919f-e10b6b2bc274 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.639976 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7456790b-5301-45e0-919f-e10b6b2bc274 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.641308 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7456790b-5301-45e0-919f-e10b6b2bc274 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.642057 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7456790b-5301-45e0-919f-e10b6b2bc274 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.872518 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-52100d7e-c611-4cf6-aa70-d03be4135de1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:16.872518 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-52100d7e-c611-4cf6-aa70-d03be4135de1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:16.894253 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-52100d7e-c611-4cf6-aa70-d03be4135de1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.897260 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-52100d7e-c611-4cf6-aa70-d03be4135de1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.899740 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-52100d7e-c611-4cf6-aa70-d03be4135de1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:16.900905 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-52100d7e-c611-4cf6-aa70-d03be4135de1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:16.930555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7456790b-5301-45e0-919f-e10b6b2bc274 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:16.948233 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7456790b-5301-45e0-919f-e10b6b2bc274 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:16.952760 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7456790b-5301-45e0-919f-e10b6b2bc274 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:16.964566 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7456790b-5301-45e0-919f-e10b6b2bc274 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1744 microversion: 2.20 time: 0.351239 May 27 09:40:16.975950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 210/427] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:16 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1744 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:17.244514 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-52100d7e-c611-4cf6-aa70-d03be4135de1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:17.254811 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-52100d7e-c611-4cf6-aa70-d03be4135de1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1708 microversion: 2.1 time: 0.390971 May 27 09:40:17.256112 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 218/428] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:16 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1708 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:17.344528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-69c99c83-33de-4079-ad1c-58c2b11b90d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:17.345638 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-69c99c83-33de-4079-ad1c-58c2b11b90d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:17.358670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-69c99c83-33de-4079-ad1c-58c2b11b90d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:17.359553 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-69c99c83-33de-4079-ad1c-58c2b11b90d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:17.360612 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-69c99c83-33de-4079-ad1c-58c2b11b90d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:17.361436 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-69c99c83-33de-4079-ad1c-58c2b11b90d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:17.437100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-69c99c83-33de-4079-ad1c-58c2b11b90d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:17.446553 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-69c99c83-33de-4079-ad1c-58c2b11b90d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1298 microversion: 2.1 time: 0.106029 May 27 09:40:17.447468 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 211/429] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:17 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:18.016985 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-678a1168-7b42-46ed-ac72-9a1acb0b19fd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:18.019328 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-678a1168-7b42-46ed-ac72-9a1acb0b19fd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:18.047443 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-678a1168-7b42-46ed-ac72-9a1acb0b19fd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:18.048808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-678a1168-7b42-46ed-ac72-9a1acb0b19fd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:18.050834 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-678a1168-7b42-46ed-ac72-9a1acb0b19fd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:18.051528 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-678a1168-7b42-46ed-ac72-9a1acb0b19fd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:18.278074 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-cb3aaad3-5e53-405e-bbbc-f52268e2bf1f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:18.278914 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-cb3aaad3-5e53-405e-bbbc-f52268e2bf1f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:18.287125 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb3aaad3-5e53-405e-bbbc-f52268e2bf1f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:18.287575 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb3aaad3-5e53-405e-bbbc-f52268e2bf1f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:18.288378 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb3aaad3-5e53-405e-bbbc-f52268e2bf1f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:18.288816 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb3aaad3-5e53-405e-bbbc-f52268e2bf1f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:18.326006 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-678a1168-7b42-46ed-ac72-9a1acb0b19fd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:18.357471 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-678a1168-7b42-46ed-ac72-9a1acb0b19fd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:18.361852 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-678a1168-7b42-46ed-ac72-9a1acb0b19fd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:18.364679 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-678a1168-7b42-46ed-ac72-9a1acb0b19fd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1744 microversion: 2.20 time: 0.360354 May 27 09:40:18.379222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 219/430] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:18 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1744 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:40:18.478608 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-55bd4165-6adc-48a0-8331-ce2c7b621091 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:18.478608 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-55bd4165-6adc-48a0-8331-ce2c7b621091 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:18.488934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-55bd4165-6adc-48a0-8331-ce2c7b621091 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:18.489729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-55bd4165-6adc-48a0-8331-ce2c7b621091 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:18.491483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-55bd4165-6adc-48a0-8331-ce2c7b621091 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:18.496733 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-55bd4165-6adc-48a0-8331-ce2c7b621091 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:18.559016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cb3aaad3-5e53-405e-bbbc-f52268e2bf1f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:18.575344 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-cb3aaad3-5e53-405e-bbbc-f52268e2bf1f tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1708 microversion: 2.1 time: 0.300719 May 27 09:40:18.577127 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 212/431] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:18 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1708 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:18.604113 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-55bd4165-6adc-48a0-8331-ce2c7b621091 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:18.613185 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-55bd4165-6adc-48a0-8331-ce2c7b621091 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1298 microversion: 2.1 time: 0.151393 May 27 09:40:18.613991 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 220/432] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:18 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1298 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:19.399230 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e26609cb-8013-46c6-a612-e53e88bc3d8f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:19.399889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e26609cb-8013-46c6-a612-e53e88bc3d8f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:19.410816 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e26609cb-8013-46c6-a612-e53e88bc3d8f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:19.411960 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e26609cb-8013-46c6-a612-e53e88bc3d8f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.413224 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e26609cb-8013-46c6-a612-e53e88bc3d8f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:19.413744 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e26609cb-8013-46c6-a612-e53e88bc3d8f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.608813 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1acc67f4-05bb-4514-b6cb-8fc1f714ff8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:19.610854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1acc67f4-05bb-4514-b6cb-8fc1f714ff8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:19.622764 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1acc67f4-05bb-4514-b6cb-8fc1f714ff8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:19.624098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1acc67f4-05bb-4514-b6cb-8fc1f714ff8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.625750 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1acc67f4-05bb-4514-b6cb-8fc1f714ff8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:19.626806 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1acc67f4-05bb-4514-b6cb-8fc1f714ff8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.672390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e26609cb-8013-46c6-a612-e53e88bc3d8f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:19.690066 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e26609cb-8013-46c6-a612-e53e88bc3d8f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:19.693957 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e26609cb-8013-46c6-a612-e53e88bc3d8f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:19.696239 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e26609cb-8013-46c6-a612-e53e88bc3d8f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1744 microversion: 2.20 time: 0.301024 May 27 09:40:19.711332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 213/433] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:19 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1744 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:19.734795 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6ce57b99-637a-494e-953b-376de95d34d1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:19.736173 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6ce57b99-637a-494e-953b-376de95d34d1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:19.747581 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ce57b99-637a-494e-953b-376de95d34d1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:19.748466 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ce57b99-637a-494e-953b-376de95d34d1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.749909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ce57b99-637a-494e-953b-376de95d34d1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:19.751036 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6ce57b99-637a-494e-953b-376de95d34d1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:19.874782 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6ce57b99-637a-494e-953b-376de95d34d1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:19.892748 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6ce57b99-637a-494e-953b-376de95d34d1 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1298 microversion: 2.1 time: 0.166003 May 27 09:40:19.893804 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 214/434] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:19 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1298 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:19.895808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1acc67f4-05bb-4514-b6cb-8fc1f714ff8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:19.908354 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1acc67f4-05bb-4514-b6cb-8fc1f714ff8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1708 microversion: 2.1 time: 0.308045 May 27 09:40:19.908955 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 221/435] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:19 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1708 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:20.731372 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-cb86fd0a-206a-4be4-99ba-87df2f12c65d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:20.733642 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-cb86fd0a-206a-4be4-99ba-87df2f12c65d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:20.743911 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:20.747574 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb86fd0a-206a-4be4-99ba-87df2f12c65d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.748682 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb86fd0a-206a-4be4-99ba-87df2f12c65d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:20.750404 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb86fd0a-206a-4be4-99ba-87df2f12c65d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.751417 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cb86fd0a-206a-4be4-99ba-87df2f12c65d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:20.892638 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-c7100ffc-2f15-4869-b013-6c8bbd5ba15b req-a741ea43-ceb1-438b-9630-d07d56504be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f38432-87c8-46fe-b6fe-4795162677ca", "name": "network-vif-plugged", "status": "completed", "tag": "791d9d86-9101-48e0-92fa-96a2b245c1d6"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:20.922331 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-c7100ffc-2f15-4869-b013-6c8bbd5ba15b req-a741ea43-ceb1-438b-9630-d07d56504be8 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.923708 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-c7100ffc-2f15-4869-b013-6c8bbd5ba15b req-a741ea43-ceb1-438b-9630-d07d56504be8 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:20.951144 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-c7100ffc-2f15-4869-b013-6c8bbd5ba15b req-a741ea43-ceb1-438b-9630-d07d56504be8 service nova] Creating event network-vif-plugged:791d9d86-9101-48e0-92fa-96a2b245c1d6 for instance 68f38432-87c8-46fe-b6fe-4795162677ca on hv-cinder-82549 May 27 09:40:20.960162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-c7100ffc-2f15-4869-b013-6c8bbd5ba15b req-a741ea43-ceb1-438b-9630-d07d56504be8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075654 May 27 09:40:20.961998 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 222/436] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:20.970076 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6f8e94a8-5f00-4db5-b9ba-3e4a7a918e42 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:20.971095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6f8e94a8-5f00-4db5-b9ba-3e4a7a918e42 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:20.983862 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f8e94a8-5f00-4db5-b9ba-3e4a7a918e42 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.985686 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f8e94a8-5f00-4db5-b9ba-3e4a7a918e42 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:20.986583 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f8e94a8-5f00-4db5-b9ba-3e4a7a918e42 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:20.987222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f8e94a8-5f00-4db5-b9ba-3e4a7a918e42 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:21.009672 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cb86fd0a-206a-4be4-99ba-87df2f12c65d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:21.035764 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cb86fd0a-206a-4be4-99ba-87df2f12c65d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:21.037332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cb86fd0a-206a-4be4-99ba-87df2f12c65d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:21.043645 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-cb86fd0a-206a-4be4-99ba-87df2f12c65d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1744 microversion: 2.20 time: 0.320050 May 27 09:40:21.057227 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 215/437] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:20 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1744 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:21.074547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-818a85a8-074c-47f6-8aa2-55acec910f2a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:21.076989 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-818a85a8-074c-47f6-8aa2-55acec910f2a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:21.083240 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-818a85a8-074c-47f6-8aa2-55acec910f2a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:21.083684 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-818a85a8-074c-47f6-8aa2-55acec910f2a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:21.084480 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-818a85a8-074c-47f6-8aa2-55acec910f2a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:21.085102 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-818a85a8-074c-47f6-8aa2-55acec910f2a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:21.107765 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-6f8e94a8-5f00-4db5-b9ba-3e4a7a918e42 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:21.123581 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6f8e94a8-5f00-4db5-b9ba-3e4a7a918e42 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1298 microversion: 2.1 time: 0.159359 May 27 09:40:21.124509 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 223/438] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:20 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1298 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:21.322821 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-818a85a8-074c-47f6-8aa2-55acec910f2a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:21.342355 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-818a85a8-074c-47f6-8aa2-55acec910f2a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1708 microversion: 2.1 time: 0.271234 May 27 09:40:21.343797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 216/439] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:21 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1708 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:22.063322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4ed18638-c2cf-4870-9371-bee019e5a722 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:22.063948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4ed18638-c2cf-4870-9371-bee019e5a722 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:22.070877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ed18638-c2cf-4870-9371-bee019e5a722 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.071333 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ed18638-c2cf-4870-9371-bee019e5a722 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.072125 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ed18638-c2cf-4870-9371-bee019e5a722 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.076302 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ed18638-c2cf-4870-9371-bee019e5a722 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.148490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d24f8698-cc23-4823-8bbc-dd3fa0a6c402 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:22.149557 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d24f8698-cc23-4823-8bbc-dd3fa0a6c402 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:22.158000 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d24f8698-cc23-4823-8bbc-dd3fa0a6c402 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.158000 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d24f8698-cc23-4823-8bbc-dd3fa0a6c402 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.158688 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d24f8698-cc23-4823-8bbc-dd3fa0a6c402 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.159277 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d24f8698-cc23-4823-8bbc-dd3fa0a6c402 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.266755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d24f8698-cc23-4823-8bbc-dd3fa0a6c402 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:22.273483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4ed18638-c2cf-4870-9371-bee019e5a722 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:22.277081 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d24f8698-cc23-4823-8bbc-dd3fa0a6c402 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1298 microversion: 2.1 time: 0.132560 May 27 09:40:22.283886 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4ed18638-c2cf-4870-9371-bee019e5a722 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:22.286229 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4ed18638-c2cf-4870-9371-bee019e5a722 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:22.287767 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4ed18638-c2cf-4870-9371-bee019e5a722 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1744 microversion: 2.20 time: 0.228487 May 27 09:40:22.288930 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 224/440] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:22 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1744 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:22.304130 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 217/441] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:22 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1298 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:22.371890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-060d7e26-d06d-41c6-a292-49e69d525305 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:22.372877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-060d7e26-d06d-41c6-a292-49e69d525305 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:22.381127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-060d7e26-d06d-41c6-a292-49e69d525305 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.381585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-060d7e26-d06d-41c6-a292-49e69d525305 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.382431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-060d7e26-d06d-41c6-a292-49e69d525305 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:22.383582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-060d7e26-d06d-41c6-a292-49e69d525305 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:22.554504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-060d7e26-d06d-41c6-a292-49e69d525305 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:22.563150 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-060d7e26-d06d-41c6-a292-49e69d525305 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1708 microversion: 2.1 time: 0.196398 May 27 09:40:22.566465 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 225/442] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:22 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1708 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:23.309459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-801fe504-f12c-4167-af08-c45a95f51422 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:23.310893 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-801fe504-f12c-4167-af08-c45a95f51422 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:23.315791 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-00c5e4cd-be01-422f-808a-0b283588d5d6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:23.317335 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-00c5e4cd-be01-422f-808a-0b283588d5d6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:23.318169 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-801fe504-f12c-4167-af08-c45a95f51422 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.318922 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-801fe504-f12c-4167-af08-c45a95f51422 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.320042 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-801fe504-f12c-4167-af08-c45a95f51422 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.320885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-801fe504-f12c-4167-af08-c45a95f51422 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.330165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-00c5e4cd-be01-422f-808a-0b283588d5d6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.343594 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-00c5e4cd-be01-422f-808a-0b283588d5d6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.343594 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-00c5e4cd-be01-422f-808a-0b283588d5d6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.343594 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-00c5e4cd-be01-422f-808a-0b283588d5d6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.440312 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-801fe504-f12c-4167-af08-c45a95f51422 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:23.449950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-801fe504-f12c-4167-af08-c45a95f51422 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1306 microversion: 2.1 time: 0.150190 May 27 09:40:23.458939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 218/443] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:23 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1306 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:23.601367 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a24c30b7-9ca2-48f4-b216-46a52d8feea0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:23.603685 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a24c30b7-9ca2-48f4-b216-46a52d8feea0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:23.617655 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:23.620534 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a24c30b7-9ca2-48f4-b216-46a52d8feea0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.621338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a24c30b7-9ca2-48f4-b216-46a52d8feea0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.622373 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a24c30b7-9ca2-48f4-b216-46a52d8feea0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:23.622924 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a24c30b7-9ca2-48f4-b216-46a52d8feea0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:23.646439 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-00c5e4cd-be01-422f-808a-0b283588d5d6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:23.668716 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-00c5e4cd-be01-422f-808a-0b283588d5d6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:23.671208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-00c5e4cd-be01-422f-808a-0b283588d5d6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:23.672736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-00c5e4cd-be01-422f-808a-0b283588d5d6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1744 microversion: 2.20 time: 0.363710 May 27 09:40:23.673805 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 226/444] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:23 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1744 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:40:23.853826 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a24c30b7-9ca2-48f4-b216-46a52d8feea0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:23.866538 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a24c30b7-9ca2-48f4-b216-46a52d8feea0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1712 microversion: 2.1 time: 0.278482 May 27 09:40:23.869021 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 219/445] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:23 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1712 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:24.489602 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e169d6aa-4c23-48b7-bd47-0136bfbea397 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:24.495267 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e169d6aa-4c23-48b7-bd47-0136bfbea397 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:24.517232 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e169d6aa-4c23-48b7-bd47-0136bfbea397 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:24.526504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e169d6aa-4c23-48b7-bd47-0136bfbea397 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:24.535894 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e169d6aa-4c23-48b7-bd47-0136bfbea397 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:24.535894 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e169d6aa-4c23-48b7-bd47-0136bfbea397 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:24.696618 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-cd994a07-e434-4b9b-80c3-9dadc24b55cd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:24.706393 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e169d6aa-4c23-48b7-bd47-0136bfbea397 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:24.710718 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-cd994a07-e434-4b9b-80c3-9dadc24b55cd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:24.732665 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e169d6aa-4c23-48b7-bd47-0136bfbea397 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1304 microversion: 2.1 time: 0.253752 May 27 09:40:24.733883 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cd994a07-e434-4b9b-80c3-9dadc24b55cd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:24.735786 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cd994a07-e434-4b9b-80c3-9dadc24b55cd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:24.736311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 227/446] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:24 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1304 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:24.737675 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cd994a07-e434-4b9b-80c3-9dadc24b55cd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:24.738337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cd994a07-e434-4b9b-80c3-9dadc24b55cd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:24.959015 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cd994a07-e434-4b9b-80c3-9dadc24b55cd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:24.969706 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cd994a07-e434-4b9b-80c3-9dadc24b55cd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:24.971880 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cd994a07-e434-4b9b-80c3-9dadc24b55cd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:24.973536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-cd994a07-e434-4b9b-80c3-9dadc24b55cd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1744 microversion: 2.20 time: 0.284150 May 27 09:40:24.984943 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 220/447] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:24 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1744 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:25.763097 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-fba87752-b1c2-4d47-aace-8a665189ddc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:25.763973 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-fba87752-b1c2-4d47-aace-8a665189ddc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:25.772543 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fba87752-b1c2-4d47-aace-8a665189ddc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:25.779368 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fba87752-b1c2-4d47-aace-8a665189ddc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:25.779368 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fba87752-b1c2-4d47-aace-8a665189ddc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:25.779368 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fba87752-b1c2-4d47-aace-8a665189ddc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:26.004167 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-baf0eba3-ae51-4123-95b2-7af12a8b7699 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:26.009107 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-baf0eba3-ae51-4123-95b2-7af12a8b7699 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:26.017096 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=14 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:26.032535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-baf0eba3-ae51-4123-95b2-7af12a8b7699 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:26.034439 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-baf0eba3-ae51-4123-95b2-7af12a8b7699 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:26.036620 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-baf0eba3-ae51-4123-95b2-7af12a8b7699 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:26.045375 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-baf0eba3-ae51-4123-95b2-7af12a8b7699 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:26.373901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fba87752-b1c2-4d47-aace-8a665189ddc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:26.395013 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-fba87752-b1c2-4d47-aace-8a665189ddc3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.633319 May 27 09:40:26.422419 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 228/448] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:25 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:26.527368 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-baf0eba3-ae51-4123-95b2-7af12a8b7699 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:26.565728 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-baf0eba3-ae51-4123-95b2-7af12a8b7699 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:26.577704 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-baf0eba3-ae51-4123-95b2-7af12a8b7699 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:26.582496 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-baf0eba3-ae51-4123-95b2-7af12a8b7699 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.589719 May 27 09:40:26.583082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 221/449] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:25 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:40:27.399932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-bf9d6552-34e0-4b6a-9bac-9fb70400d16c req-62aa739a-5973-4c8a-9016-fae55a34352c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b03ea7-b697-47df-898f-33d7f45ab279", "tag": "e00cf8d3-9ed6-423d-8c16-e7f1a0445c42"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:27.424149 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-588bcd94-e89c-4921-957b-3bfbb26d339c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:27.432564 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-588bcd94-e89c-4921-957b-3bfbb26d339c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:27.458057 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-588bcd94-e89c-4921-957b-3bfbb26d339c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:27.473670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-588bcd94-e89c-4921-957b-3bfbb26d339c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:27.475007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-bf9d6552-34e0-4b6a-9bac-9fb70400d16c req-62aa739a-5973-4c8a-9016-fae55a34352c service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:27.481067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-bf9d6552-34e0-4b6a-9bac-9fb70400d16c req-62aa739a-5973-4c8a-9016-fae55a34352c service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:27.481303 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-588bcd94-e89c-4921-957b-3bfbb26d339c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:27.488119 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-588bcd94-e89c-4921-957b-3bfbb26d339c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:27.535459 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-bf9d6552-34e0-4b6a-9bac-9fb70400d16c req-62aa739a-5973-4c8a-9016-fae55a34352c service nova] Creating event network-changed:e00cf8d3-9ed6-423d-8c16-e7f1a0445c42 for instance 28b03ea7-b697-47df-898f-33d7f45ab279 on hv-cinder-82549 May 27 09:40:27.591306 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-bf9d6552-34e0-4b6a-9bac-9fb70400d16c req-62aa739a-5973-4c8a-9016-fae55a34352c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.194072 May 27 09:40:27.593379 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 229/450] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:40:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:27.632477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5a7a015c-0b4d-42fa-b207-96adf51bc0f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:27.635863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5a7a015c-0b4d-42fa-b207-96adf51bc0f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:27.676124 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5a7a015c-0b4d-42fa-b207-96adf51bc0f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:27.699791 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5a7a015c-0b4d-42fa-b207-96adf51bc0f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:27.701665 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5a7a015c-0b4d-42fa-b207-96adf51bc0f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:27.703968 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5a7a015c-0b4d-42fa-b207-96adf51bc0f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:28.265195 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-588bcd94-e89c-4921-957b-3bfbb26d339c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:28.288103 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-588bcd94-e89c-4921-957b-3bfbb26d339c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.863007 May 27 09:40:28.294966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 222/451] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:27 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:28.544238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5a7a015c-0b4d-42fa-b207-96adf51bc0f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:28.561294 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5a7a015c-0b4d-42fa-b207-96adf51bc0f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:28.563221 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5a7a015c-0b4d-42fa-b207-96adf51bc0f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:28.564640 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5a7a015c-0b4d-42fa-b207-96adf51bc0f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.958884 May 27 09:40:28.578675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 230/452] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:27 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:29.324449 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ca739b57-857c-4be7-b4d3-fe209646cdf3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:29.325289 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ca739b57-857c-4be7-b4d3-fe209646cdf3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:29.341960 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca739b57-857c-4be7-b4d3-fe209646cdf3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:29.343100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca739b57-857c-4be7-b4d3-fe209646cdf3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:29.344211 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca739b57-857c-4be7-b4d3-fe209646cdf3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:29.344837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ca739b57-857c-4be7-b4d3-fe209646cdf3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:29.587100 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e334cf6f-f264-40d4-ba5b-5c55a6d288b2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:29.590133 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e334cf6f-f264-40d4-ba5b-5c55a6d288b2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:29.613020 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=74 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:29.619072 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e334cf6f-f264-40d4-ba5b-5c55a6d288b2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:29.620050 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e334cf6f-f264-40d4-ba5b-5c55a6d288b2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:29.622415 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e334cf6f-f264-40d4-ba5b-5c55a6d288b2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:29.625362 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e334cf6f-f264-40d4-ba5b-5c55a6d288b2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:29.646813 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ca739b57-857c-4be7-b4d3-fe209646cdf3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:29.671474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ca739b57-857c-4be7-b4d3-fe209646cdf3 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.351947 May 27 09:40:29.673361 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 223/453] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:29 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:29.940145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e334cf6f-f264-40d4-ba5b-5c55a6d288b2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:29.958252 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e334cf6f-f264-40d4-ba5b-5c55a6d288b2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:29.962524 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e334cf6f-f264-40d4-ba5b-5c55a6d288b2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:29.962524 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e334cf6f-f264-40d4-ba5b-5c55a6d288b2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.380351 May 27 09:40:29.964029 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 231/454] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:29 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:30.699406 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1279258f-7e36-41bf-8710-a0f39d29ca88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:30.700505 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1279258f-7e36-41bf-8710-a0f39d29ca88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:30.712497 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1279258f-7e36-41bf-8710-a0f39d29ca88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:30.713713 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1279258f-7e36-41bf-8710-a0f39d29ca88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:30.715461 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1279258f-7e36-41bf-8710-a0f39d29ca88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:30.716526 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1279258f-7e36-41bf-8710-a0f39d29ca88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:30.958070 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1279258f-7e36-41bf-8710-a0f39d29ca88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:30.960651 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=100 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:30.970162 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1279258f-7e36-41bf-8710-a0f39d29ca88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.273764 May 27 09:40:30.971621 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 224/455] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:30 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:30.984785 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-da22ac99-f70b-439c-9c8d-fd3d9a6d9361 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:30.985677 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-da22ac99-f70b-439c-9c8d-fd3d9a6d9361 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:31.017995 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da22ac99-f70b-439c-9c8d-fd3d9a6d9361 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:31.018761 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da22ac99-f70b-439c-9c8d-fd3d9a6d9361 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:31.025066 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da22ac99-f70b-439c-9c8d-fd3d9a6d9361 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:31.031036 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da22ac99-f70b-439c-9c8d-fd3d9a6d9361 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:31.211418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-da22ac99-f70b-439c-9c8d-fd3d9a6d9361 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:31.222976 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-da22ac99-f70b-439c-9c8d-fd3d9a6d9361 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:31.224503 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-da22ac99-f70b-439c-9c8d-fd3d9a6d9361 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:31.225704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-da22ac99-f70b-439c-9c8d-fd3d9a6d9361 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.248255 May 27 09:40:31.226664 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 232/456] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:30 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:31.996691 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-593f8e25-8da1-4a2d-9428-9dd64ccfb469 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:31.997457 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-593f8e25-8da1-4a2d-9428-9dd64ccfb469 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:32.004807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-593f8e25-8da1-4a2d-9428-9dd64ccfb469 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:32.005254 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-593f8e25-8da1-4a2d-9428-9dd64ccfb469 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:32.006045 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-593f8e25-8da1-4a2d-9428-9dd64ccfb469 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:32.006509 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-593f8e25-8da1-4a2d-9428-9dd64ccfb469 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:32.249654 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4c0687ca-7726-451f-a443-4b56cb7d87ff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:32.259500 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4c0687ca-7726-451f-a443-4b56cb7d87ff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:32.334311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4c0687ca-7726-451f-a443-4b56cb7d87ff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:32.335419 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4c0687ca-7726-451f-a443-4b56cb7d87ff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:32.337988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4c0687ca-7726-451f-a443-4b56cb7d87ff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:32.347619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4c0687ca-7726-451f-a443-4b56cb7d87ff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:32.499896 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=100 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:32.587100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-593f8e25-8da1-4a2d-9428-9dd64ccfb469 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:32.603180 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-593f8e25-8da1-4a2d-9428-9dd64ccfb469 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.612320 May 27 09:40:32.604953 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 225/457] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:31 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:33.245811 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4c0687ca-7726-451f-a443-4b56cb7d87ff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:33.260612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4c0687ca-7726-451f-a443-4b56cb7d87ff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:33.263970 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4c0687ca-7726-451f-a443-4b56cb7d87ff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:33.266304 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4c0687ca-7726-451f-a443-4b56cb7d87ff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 1.023798 May 27 09:40:33.290804 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 233/458] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:32 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:33.633603 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-18a94f15-e7fd-4bc6-be8d-6ed5241cc0df tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:33.634412 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-18a94f15-e7fd-4bc6-be8d-6ed5241cc0df tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:33.652017 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-18a94f15-e7fd-4bc6-be8d-6ed5241cc0df tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:33.659249 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-18a94f15-e7fd-4bc6-be8d-6ed5241cc0df tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:33.671820 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-18a94f15-e7fd-4bc6-be8d-6ed5241cc0df tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:33.676059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-18a94f15-e7fd-4bc6-be8d-6ed5241cc0df tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:33.992505 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-18a94f15-e7fd-4bc6-be8d-6ed5241cc0df tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:34.019141 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-18a94f15-e7fd-4bc6-be8d-6ed5241cc0df tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.390342 May 27 09:40:34.028139 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 226/459] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:33 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:34.314586 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0327500e-4b67-43ec-a0ae-dcdd2d99df54 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:34.316790 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0327500e-4b67-43ec-a0ae-dcdd2d99df54 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:34.328937 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0327500e-4b67-43ec-a0ae-dcdd2d99df54 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:34.334478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0327500e-4b67-43ec-a0ae-dcdd2d99df54 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:34.334478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0327500e-4b67-43ec-a0ae-dcdd2d99df54 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:34.334478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0327500e-4b67-43ec-a0ae-dcdd2d99df54 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:34.557243 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0327500e-4b67-43ec-a0ae-dcdd2d99df54 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:34.585660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0327500e-4b67-43ec-a0ae-dcdd2d99df54 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:34.595337 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0327500e-4b67-43ec-a0ae-dcdd2d99df54 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:34.596961 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0327500e-4b67-43ec-a0ae-dcdd2d99df54 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.300435 May 27 09:40:34.608628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 234/460] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:34 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:35.040114 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e3af6d7e-6112-4190-917b-e1ba6285b38d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:35.041233 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e3af6d7e-6112-4190-917b-e1ba6285b38d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:35.071377 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e3af6d7e-6112-4190-917b-e1ba6285b38d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:35.072523 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e3af6d7e-6112-4190-917b-e1ba6285b38d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:35.074249 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e3af6d7e-6112-4190-917b-e1ba6285b38d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:35.075288 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e3af6d7e-6112-4190-917b-e1ba6285b38d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:35.371533 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e3af6d7e-6112-4190-917b-e1ba6285b38d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:35.394628 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e3af6d7e-6112-4190-917b-e1ba6285b38d tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.360908 May 27 09:40:35.395847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 227/461] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:35 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:35.616214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0f1a84f8-d7b0-4d77-9078-b2fbddc157c7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:35.617715 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0f1a84f8-d7b0-4d77-9078-b2fbddc157c7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:35.626120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0f1a84f8-d7b0-4d77-9078-b2fbddc157c7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:35.626932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0f1a84f8-d7b0-4d77-9078-b2fbddc157c7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:35.627952 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0f1a84f8-d7b0-4d77-9078-b2fbddc157c7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:35.628606 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0f1a84f8-d7b0-4d77-9078-b2fbddc157c7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:36.057888 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0f1a84f8-d7b0-4d77-9078-b2fbddc157c7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:36.081074 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0f1a84f8-d7b0-4d77-9078-b2fbddc157c7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:36.085367 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0f1a84f8-d7b0-4d77-9078-b2fbddc157c7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:36.088321 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0f1a84f8-d7b0-4d77-9078-b2fbddc157c7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.475944 May 27 09:40:36.090429 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 235/462] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:35 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:36.412199 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3d1af043-85f1-4023-a55a-ab172c6ba789 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:36.453090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3d1af043-85f1-4023-a55a-ab172c6ba789 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:36.453090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3d1af043-85f1-4023-a55a-ab172c6ba789 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:36.453090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3d1af043-85f1-4023-a55a-ab172c6ba789 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:36.453090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3d1af043-85f1-4023-a55a-ab172c6ba789 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:36.453526 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3d1af043-85f1-4023-a55a-ab172c6ba789 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:36.572847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3d1af043-85f1-4023-a55a-ab172c6ba789 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:36.580464 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3d1af043-85f1-4023-a55a-ab172c6ba789 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.172243 May 27 09:40:36.581025 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 228/463] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:36 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:37.110915 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-88134fd0-ee4f-48f0-a634-377461e06d32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:37.112604 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-88134fd0-ee4f-48f0-a634-377461e06d32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:37.133205 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-88134fd0-ee4f-48f0-a634-377461e06d32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:37.133777 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-88134fd0-ee4f-48f0-a634-377461e06d32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:37.134695 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-88134fd0-ee4f-48f0-a634-377461e06d32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:37.135223 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-88134fd0-ee4f-48f0-a634-377461e06d32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:37.331503 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-88134fd0-ee4f-48f0-a634-377461e06d32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:37.344202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-88134fd0-ee4f-48f0-a634-377461e06d32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:37.346857 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-88134fd0-ee4f-48f0-a634-377461e06d32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:37.348522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-88134fd0-ee4f-48f0-a634-377461e06d32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.243975 May 27 09:40:37.349796 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 236/464] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:37 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:37.596929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-22c2f2bd-4f35-4081-8bd0-a4c116961c64 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:37.597523 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-22c2f2bd-4f35-4081-8bd0-a4c116961c64 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:37.606342 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-22c2f2bd-4f35-4081-8bd0-a4c116961c64 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:37.607185 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-22c2f2bd-4f35-4081-8bd0-a4c116961c64 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:37.608081 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-22c2f2bd-4f35-4081-8bd0-a4c116961c64 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:37.608581 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-22c2f2bd-4f35-4081-8bd0-a4c116961c64 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:37.815674 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-22c2f2bd-4f35-4081-8bd0-a4c116961c64 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:37.825058 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-22c2f2bd-4f35-4081-8bd0-a4c116961c64 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.231847 May 27 09:40:37.825651 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 229/465] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:37 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:38.369722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-aaf144ea-d0bd-419e-bb61-4a9d84dcddff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:38.370674 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-aaf144ea-d0bd-419e-bb61-4a9d84dcddff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:38.377219 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aaf144ea-d0bd-419e-bb61-4a9d84dcddff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:38.385299 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aaf144ea-d0bd-419e-bb61-4a9d84dcddff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:38.385299 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aaf144ea-d0bd-419e-bb61-4a9d84dcddff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:38.385299 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aaf144ea-d0bd-419e-bb61-4a9d84dcddff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:38.534691 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-aaf144ea-d0bd-419e-bb61-4a9d84dcddff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:38.546318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-aaf144ea-d0bd-419e-bb61-4a9d84dcddff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:38.548095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-aaf144ea-d0bd-419e-bb61-4a9d84dcddff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:38.549269 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-aaf144ea-d0bd-419e-bb61-4a9d84dcddff tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.184138 May 27 09:40:38.549986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 237/466] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:38 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:38.846402 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b8fe790e-14bc-4b26-9df0-7d3151e92157 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:38.847203 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b8fe790e-14bc-4b26-9df0-7d3151e92157 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:38.854797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b8fe790e-14bc-4b26-9df0-7d3151e92157 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:38.855640 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b8fe790e-14bc-4b26-9df0-7d3151e92157 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:38.856646 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b8fe790e-14bc-4b26-9df0-7d3151e92157 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:38.857230 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b8fe790e-14bc-4b26-9df0-7d3151e92157 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:39.017010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b8fe790e-14bc-4b26-9df0-7d3151e92157 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:39.025744 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b8fe790e-14bc-4b26-9df0-7d3151e92157 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.183343 May 27 09:40:39.027007 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 230/467] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:38 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:40:39.591795 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-fa9c6ee5-5094-4579-ba3d-e979cf9e88e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:39.593979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-fa9c6ee5-5094-4579-ba3d-e979cf9e88e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:39.607866 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fa9c6ee5-5094-4579-ba3d-e979cf9e88e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:39.607866 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fa9c6ee5-5094-4579-ba3d-e979cf9e88e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:39.608521 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fa9c6ee5-5094-4579-ba3d-e979cf9e88e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:39.608975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fa9c6ee5-5094-4579-ba3d-e979cf9e88e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:39.653922 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-c83420d8-67f0-4cab-8538-93c84a74da36 req-a44f589a-7e9a-4be1-bd9f-7058cee4f12e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b03ea7-b697-47df-898f-33d7f45ab279", "name": "network-vif-plugged", "status": "completed", "tag": "e00cf8d3-9ed6-423d-8c16-e7f1a0445c42"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:39.668810 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-c83420d8-67f0-4cab-8538-93c84a74da36 req-a44f589a-7e9a-4be1-bd9f-7058cee4f12e service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:39.669257 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-c83420d8-67f0-4cab-8538-93c84a74da36 req-a44f589a-7e9a-4be1-bd9f-7058cee4f12e service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:39.685578 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-c83420d8-67f0-4cab-8538-93c84a74da36 req-a44f589a-7e9a-4be1-bd9f-7058cee4f12e service nova] Creating event network-vif-plugged:e00cf8d3-9ed6-423d-8c16-e7f1a0445c42 for instance 28b03ea7-b697-47df-898f-33d7f45ab279 on hv-cinder-82549 May 27 09:40:39.699809 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-c83420d8-67f0-4cab-8538-93c84a74da36 req-a44f589a-7e9a-4be1-bd9f-7058cee4f12e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049752 May 27 09:40:39.700822 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 231/468] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:40:39.818408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fa9c6ee5-5094-4579-ba3d-e979cf9e88e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:39.832814 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fa9c6ee5-5094-4579-ba3d-e979cf9e88e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:39.835465 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fa9c6ee5-5094-4579-ba3d-e979cf9e88e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:39.844601 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-fa9c6ee5-5094-4579-ba3d-e979cf9e88e7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.261981 May 27 09:40:39.856432 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 238/469] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:39 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:40.045150 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-05e5e212-3507-4539-995f-39e6806e0eea tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:40.045865 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-05e5e212-3507-4539-995f-39e6806e0eea tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:40.052855 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05e5e212-3507-4539-995f-39e6806e0eea tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:40.053314 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05e5e212-3507-4539-995f-39e6806e0eea tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:40.054107 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05e5e212-3507-4539-995f-39e6806e0eea tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:40.054578 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05e5e212-3507-4539-995f-39e6806e0eea tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:40.227404 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-05e5e212-3507-4539-995f-39e6806e0eea tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:40.247408 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-05e5e212-3507-4539-995f-39e6806e0eea tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.196157 May 27 09:40:40.247408 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 232/470] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:40 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:40.863134 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1b50b3c4-4454-47ff-8499-45de011210c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:40.863746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1b50b3c4-4454-47ff-8499-45de011210c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:40.870836 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b50b3c4-4454-47ff-8499-45de011210c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:40.871321 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b50b3c4-4454-47ff-8499-45de011210c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:40.872076 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b50b3c4-4454-47ff-8499-45de011210c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:40.872512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b50b3c4-4454-47ff-8499-45de011210c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:41.016502 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1b50b3c4-4454-47ff-8499-45de011210c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:41.025536 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1b50b3c4-4454-47ff-8499-45de011210c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:41.027149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1b50b3c4-4454-47ff-8499-45de011210c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:41.028409 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1b50b3c4-4454-47ff-8499-45de011210c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.169073 May 27 09:40:41.028971 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 239/471] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:40 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:41.252381 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2d52754c-7d13-4379-bc2f-4b0d192b99d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:41.253061 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2d52754c-7d13-4379-bc2f-4b0d192b99d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:41.261681 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2d52754c-7d13-4379-bc2f-4b0d192b99d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:41.277120 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2d52754c-7d13-4379-bc2f-4b0d192b99d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:41.277120 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2d52754c-7d13-4379-bc2f-4b0d192b99d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:41.277120 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2d52754c-7d13-4379-bc2f-4b0d192b99d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:41.432836 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2d52754c-7d13-4379-bc2f-4b0d192b99d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:41.440980 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2d52754c-7d13-4379-bc2f-4b0d192b99d9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.192441 May 27 09:40:41.442237 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 233/472] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:41 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:42.047607 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a792178d-973b-4fc2-8ad4-3fc0c9bf6644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:42.048976 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a792178d-973b-4fc2-8ad4-3fc0c9bf6644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:42.055983 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a792178d-973b-4fc2-8ad4-3fc0c9bf6644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:42.056434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a792178d-973b-4fc2-8ad4-3fc0c9bf6644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:42.057240 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a792178d-973b-4fc2-8ad4-3fc0c9bf6644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:42.058182 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a792178d-973b-4fc2-8ad4-3fc0c9bf6644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:42.205637 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a792178d-973b-4fc2-8ad4-3fc0c9bf6644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:42.214615 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a792178d-973b-4fc2-8ad4-3fc0c9bf6644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:42.216138 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a792178d-973b-4fc2-8ad4-3fc0c9bf6644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:42.217471 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a792178d-973b-4fc2-8ad4-3fc0c9bf6644 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.173715 May 27 09:40:42.217891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 240/473] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:42 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:42.457911 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-920bbe52-6142-470c-a65f-61f1ca349fbd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:42.458551 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-920bbe52-6142-470c-a65f-61f1ca349fbd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:42.465534 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-920bbe52-6142-470c-a65f-61f1ca349fbd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:42.476469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-920bbe52-6142-470c-a65f-61f1ca349fbd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:42.476469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-920bbe52-6142-470c-a65f-61f1ca349fbd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:42.476469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-920bbe52-6142-470c-a65f-61f1ca349fbd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:42.621495 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-920bbe52-6142-470c-a65f-61f1ca349fbd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:42.629835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-920bbe52-6142-470c-a65f-61f1ca349fbd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1372 microversion: 2.1 time: 0.175827 May 27 09:40:42.634585 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 234/474] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:42 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:43.243390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0c970860-273b-4ccc-8f5e-e4e90e19a518 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:43.244056 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0c970860-273b-4ccc-8f5e-e4e90e19a518 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:43.251210 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0c970860-273b-4ccc-8f5e-e4e90e19a518 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:43.251696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0c970860-273b-4ccc-8f5e-e4e90e19a518 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:43.252471 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0c970860-273b-4ccc-8f5e-e4e90e19a518 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:43.252908 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0c970860-273b-4ccc-8f5e-e4e90e19a518 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:43.405660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0c970860-273b-4ccc-8f5e-e4e90e19a518 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:43.414910 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0c970860-273b-4ccc-8f5e-e4e90e19a518 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:43.417760 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0c970860-273b-4ccc-8f5e-e4e90e19a518 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:43.419801 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0c970860-273b-4ccc-8f5e-e4e90e19a518 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1739 microversion: 2.20 time: 0.181720 May 27 09:40:43.421177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 241/475] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:43 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:43.647248 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-38edc629-b06a-4f7b-a6f1-a88701d48ae9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:43.647929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-38edc629-b06a-4f7b-a6f1-a88701d48ae9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:43.663180 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-38edc629-b06a-4f7b-a6f1-a88701d48ae9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:43.663596 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-38edc629-b06a-4f7b-a6f1-a88701d48ae9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:43.664470 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-38edc629-b06a-4f7b-a6f1-a88701d48ae9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:43.664902 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-38edc629-b06a-4f7b-a6f1-a88701d48ae9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:43.805605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-38edc629-b06a-4f7b-a6f1-a88701d48ae9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:43.814028 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-38edc629-b06a-4f7b-a6f1-a88701d48ae9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1566 microversion: 2.1 time: 0.170812 May 27 09:40:43.814633 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 235/476] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:40:43 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1566 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:40:43.832221 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c61b1c6f-6aa4-4b0f-9d7b-ee5fca58dc23 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:43.834703 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c61b1c6f-6aa4-4b0f-9d7b-ee5fca58dc23 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:43.839715 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c61b1c6f-6aa4-4b0f-9d7b-ee5fca58dc23 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:43.840246 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c61b1c6f-6aa4-4b0f-9d7b-ee5fca58dc23 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:43.841114 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c61b1c6f-6aa4-4b0f-9d7b-ee5fca58dc23 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:43.841694 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c61b1c6f-6aa4-4b0f-9d7b-ee5fca58dc23 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:43.937227 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c61b1c6f-6aa4-4b0f-9d7b-ee5fca58dc23 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109365 May 27 09:40:43.937852 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 242/477] 10.222.0.48 () {58 vars in 1274 bytes} [Fri May 27 09:40:43 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:44.442347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d857d4aa-1de5-4da4-a2c4-2ae89d6ee1b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:44.443078 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d857d4aa-1de5-4da4-a2c4-2ae89d6ee1b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:44.452138 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d857d4aa-1de5-4da4-a2c4-2ae89d6ee1b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:44.452540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d857d4aa-1de5-4da4-a2c4-2ae89d6ee1b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:44.453358 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d857d4aa-1de5-4da4-a2c4-2ae89d6ee1b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:44.453765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d857d4aa-1de5-4da4-a2c4-2ae89d6ee1b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:44.612864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d857d4aa-1de5-4da4-a2c4-2ae89d6ee1b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:44.622225 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d857d4aa-1de5-4da4-a2c4-2ae89d6ee1b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:44.623949 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d857d4aa-1de5-4da4-a2c4-2ae89d6ee1b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:44.626015 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d857d4aa-1de5-4da4-a2c4-2ae89d6ee1b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1721 microversion: 2.20 time: 0.189102 May 27 09:40:44.627101 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 236/478] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:44 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:45.114698 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-d02cb50b-f4a9-428b-b6ce-578d206b6b7d req-c0b730b8-9ce7-4803-8225-ec11286d984a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b03ea7-b697-47df-898f-33d7f45ab279", "tag": "e00cf8d3-9ed6-423d-8c16-e7f1a0445c42"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:45.124434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-d02cb50b-f4a9-428b-b6ce-578d206b6b7d req-c0b730b8-9ce7-4803-8225-ec11286d984a service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:45.130738 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-d02cb50b-f4a9-428b-b6ce-578d206b6b7d req-c0b730b8-9ce7-4803-8225-ec11286d984a service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:45.136322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-d02cb50b-f4a9-428b-b6ce-578d206b6b7d req-c0b730b8-9ce7-4803-8225-ec11286d984a service nova] Creating event network-changed:e00cf8d3-9ed6-423d-8c16-e7f1a0445c42 for instance 28b03ea7-b697-47df-898f-33d7f45ab279 on hv-cinder-82549 May 27 09:40:45.141995 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-d02cb50b-f4a9-428b-b6ce-578d206b6b7d req-c0b730b8-9ce7-4803-8225-ec11286d984a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031365 May 27 09:40:45.142961 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 243/479] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:40:45.650485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ad84b49b-9709-4dcf-b9df-225ae14e09e0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:45.651275 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ad84b49b-9709-4dcf-b9df-225ae14e09e0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:45.658655 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ad84b49b-9709-4dcf-b9df-225ae14e09e0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:45.663505 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ad84b49b-9709-4dcf-b9df-225ae14e09e0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:45.663505 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ad84b49b-9709-4dcf-b9df-225ae14e09e0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:45.663505 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ad84b49b-9709-4dcf-b9df-225ae14e09e0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:45.817854 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ad84b49b-9709-4dcf-b9df-225ae14e09e0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:45.827973 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ad84b49b-9709-4dcf-b9df-225ae14e09e0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:45.829406 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ad84b49b-9709-4dcf-b9df-225ae14e09e0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:45.830799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ad84b49b-9709-4dcf-b9df-225ae14e09e0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1721 microversion: 2.20 time: 0.184676 May 27 09:40:45.831366 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 237/480] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:45 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:46.851479 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e76e2fe0-9ee2-4ded-bc41-eb77cc8ab9d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:46.852116 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e76e2fe0-9ee2-4ded-bc41-eb77cc8ab9d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:46.864191 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e76e2fe0-9ee2-4ded-bc41-eb77cc8ab9d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:46.864191 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e76e2fe0-9ee2-4ded-bc41-eb77cc8ab9d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:46.864191 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e76e2fe0-9ee2-4ded-bc41-eb77cc8ab9d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:46.864191 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e76e2fe0-9ee2-4ded-bc41-eb77cc8ab9d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:47.030125 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e76e2fe0-9ee2-4ded-bc41-eb77cc8ab9d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:47.038989 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e76e2fe0-9ee2-4ded-bc41-eb77cc8ab9d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:47.040655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e76e2fe0-9ee2-4ded-bc41-eb77cc8ab9d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:47.041896 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e76e2fe0-9ee2-4ded-bc41-eb77cc8ab9d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1724 microversion: 2.20 time: 0.195537 May 27 09:40:47.042516 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 244/481] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:46 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:47.068224 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-48318522-5bc7-428a-996f-eed8a31678d4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23ce0804-3c30-4060-b376-be478f79999c"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:47.069332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-48318522-5bc7-428a-996f-eed8a31678d4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:47.076715 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-48318522-5bc7-428a-996f-eed8a31678d4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:47.077163 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-48318522-5bc7-428a-996f-eed8a31678d4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:47.077933 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-48318522-5bc7-428a-996f-eed8a31678d4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:47.078413 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-48318522-5bc7-428a-996f-eed8a31678d4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:47.461374 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-f6e9320b-bed6-456b-9640-ac0d5d815c2f req-8b34b7c4-3768-499f-9d45-e76963cf934a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f38432-87c8-46fe-b6fe-4795162677ca", "name": "network-vif-unplugged", "status": "completed", "tag": "791d9d86-9101-48e0-92fa-96a2b245c1d6"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:47.471027 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-f6e9320b-bed6-456b-9640-ac0d5d815c2f req-8b34b7c4-3768-499f-9d45-e76963cf934a service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:47.477728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-f6e9320b-bed6-456b-9640-ac0d5d815c2f req-8b34b7c4-3768-499f-9d45-e76963cf934a service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:47.483050 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-f6e9320b-bed6-456b-9640-ac0d5d815c2f req-8b34b7c4-3768-499f-9d45-e76963cf934a service nova] Creating event network-vif-unplugged:791d9d86-9101-48e0-92fa-96a2b245c1d6 for instance 68f38432-87c8-46fe-b6fe-4795162677ca on hv-cinder-82549 May 27 09:40:47.487932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-f6e9320b-bed6-456b-9640-ac0d5d815c2f req-8b34b7c4-3768-499f-9d45-e76963cf934a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030288 May 27 09:40:47.488542 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 245/482] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:40:48.602864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-48318522-5bc7-428a-996f-eed8a31678d4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "POST /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.538730 May 27 09:40:48.617927 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 238/483] 10.222.0.48 () {62 vars in 1363 bytes} [Fri May 27 09:40:47 2022] POST /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments => generated 188 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:40:48.739049 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-685208e1-c22a-4fda-ae82-440bf80d500b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:40:48.739700 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-685208e1-c22a-4fda-ae82-440bf80d500b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:48.747390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-685208e1-c22a-4fda-ae82-440bf80d500b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:48.747843 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-685208e1-c22a-4fda-ae82-440bf80d500b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:48.748631 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-685208e1-c22a-4fda-ae82-440bf80d500b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:48.749066 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-685208e1-c22a-4fda-ae82-440bf80d500b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:49.161355 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-685208e1-c22a-4fda-ae82-440bf80d500b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "POST /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/action" status: 202 len: 0 microversion: 2.20 time: 0.426957 May 27 09:40:49.165069 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 246/484] 10.222.0.48 () {62 vars in 1318 bytes} [Fri May 27 09:40:48 2022] POST /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/action => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 09:40:49.170845 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-27381d9b-2862-44ef-ab5f-e1adc7121554 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:49.171459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-27381d9b-2862-44ef-ab5f-e1adc7121554 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:49.179152 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-27381d9b-2862-44ef-ab5f-e1adc7121554 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:49.179621 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-27381d9b-2862-44ef-ab5f-e1adc7121554 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:49.180406 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-27381d9b-2862-44ef-ab5f-e1adc7121554 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:49.180843 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-27381d9b-2862-44ef-ab5f-e1adc7121554 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:49.197254 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:49.331220 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-27381d9b-2862-44ef-ab5f-e1adc7121554 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:49.340762 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-27381d9b-2862-44ef-ab5f-e1adc7121554 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:49.343465 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-27381d9b-2862-44ef-ab5f-e1adc7121554 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:49.345484 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-27381d9b-2862-44ef-ab5f-e1adc7121554 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1750 microversion: 2.20 time: 0.178931 May 27 09:40:49.346384 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 239/485] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:49 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:50.367085 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9becd813-107a-4e07-9cc3-a681abdb4ca7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:50.367855 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9becd813-107a-4e07-9cc3-a681abdb4ca7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:50.375680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9becd813-107a-4e07-9cc3-a681abdb4ca7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:50.376140 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9becd813-107a-4e07-9cc3-a681abdb4ca7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:50.376923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9becd813-107a-4e07-9cc3-a681abdb4ca7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:50.377364 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9becd813-107a-4e07-9cc3-a681abdb4ca7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:50.520219 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9becd813-107a-4e07-9cc3-a681abdb4ca7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:50.529534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9becd813-107a-4e07-9cc3-a681abdb4ca7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:50.531069 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9becd813-107a-4e07-9cc3-a681abdb4ca7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:50.532296 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9becd813-107a-4e07-9cc3-a681abdb4ca7 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1750 microversion: 2.20 time: 0.170433 May 27 09:40:50.544007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 247/486] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:50 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1750 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:51.552335 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6e5b4e74-edc6-4df6-b532-a539d79fab6e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:51.552944 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6e5b4e74-edc6-4df6-b532-a539d79fab6e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:51.555316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=50 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:51.560680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6e5b4e74-edc6-4df6-b532-a539d79fab6e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:51.561174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6e5b4e74-edc6-4df6-b532-a539d79fab6e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:51.561939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6e5b4e74-edc6-4df6-b532-a539d79fab6e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:51.562450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6e5b4e74-edc6-4df6-b532-a539d79fab6e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:51.699990 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6e5b4e74-edc6-4df6-b532-a539d79fab6e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:51.707422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6e5b4e74-edc6-4df6-b532-a539d79fab6e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:51.708987 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6e5b4e74-edc6-4df6-b532-a539d79fab6e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:51.710170 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6e5b4e74-edc6-4df6-b532-a539d79fab6e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1752 microversion: 2.20 time: 0.162663 May 27 09:40:51.710747 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 240/487] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:51 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1752 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:52.730337 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2635de62-8a06-4c1e-b2b6-bff942005bd0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:52.731076 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2635de62-8a06-4c1e-b2b6-bff942005bd0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:52.739263 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2635de62-8a06-4c1e-b2b6-bff942005bd0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:52.739706 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2635de62-8a06-4c1e-b2b6-bff942005bd0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:52.740508 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2635de62-8a06-4c1e-b2b6-bff942005bd0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:52.740935 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2635de62-8a06-4c1e-b2b6-bff942005bd0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:52.898516 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2635de62-8a06-4c1e-b2b6-bff942005bd0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:52.908570 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2635de62-8a06-4c1e-b2b6-bff942005bd0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:52.910095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2635de62-8a06-4c1e-b2b6-bff942005bd0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:52.911299 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2635de62-8a06-4c1e-b2b6-bff942005bd0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1752 microversion: 2.20 time: 0.185459 May 27 09:40:52.911858 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 248/488] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:52 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:53.935415 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2b1d1282-c180-43c5-83b6-ac31625d2a41 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:53.936501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2b1d1282-c180-43c5-83b6-ac31625d2a41 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:53.944037 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2b1d1282-c180-43c5-83b6-ac31625d2a41 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:53.944566 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2b1d1282-c180-43c5-83b6-ac31625d2a41 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:53.945342 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2b1d1282-c180-43c5-83b6-ac31625d2a41 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:53.945786 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2b1d1282-c180-43c5-83b6-ac31625d2a41 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:54.096393 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2b1d1282-c180-43c5-83b6-ac31625d2a41 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:54.105873 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2b1d1282-c180-43c5-83b6-ac31625d2a41 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:54.107428 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2b1d1282-c180-43c5-83b6-ac31625d2a41 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:54.108727 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2b1d1282-c180-43c5-83b6-ac31625d2a41 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.178047 May 27 09:40:54.109743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 241/489] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:53 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:55.127284 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2767266c-2343-4f93-8262-5a54f7e9f14d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:55.127983 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2767266c-2343-4f93-8262-5a54f7e9f14d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:55.139095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2767266c-2343-4f93-8262-5a54f7e9f14d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:55.139544 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2767266c-2343-4f93-8262-5a54f7e9f14d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:55.140311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2767266c-2343-4f93-8262-5a54f7e9f14d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:55.140742 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2767266c-2343-4f93-8262-5a54f7e9f14d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:55.588988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2767266c-2343-4f93-8262-5a54f7e9f14d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:55.601123 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2767266c-2343-4f93-8262-5a54f7e9f14d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:55.604957 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2767266c-2343-4f93-8262-5a54f7e9f14d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:55.606483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2767266c-2343-4f93-8262-5a54f7e9f14d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.483036 May 27 09:40:55.608514 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 249/490] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:55 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:56.627236 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e4360f94-341f-464f-a345-be541e431169 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:56.627852 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e4360f94-341f-464f-a345-be541e431169 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:56.634213 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e4360f94-341f-464f-a345-be541e431169 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:56.634669 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e4360f94-341f-464f-a345-be541e431169 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:56.635509 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e4360f94-341f-464f-a345-be541e431169 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:56.635945 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e4360f94-341f-464f-a345-be541e431169 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:56.787671 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e4360f94-341f-464f-a345-be541e431169 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:56.796649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e4360f94-341f-464f-a345-be541e431169 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:56.798152 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e4360f94-341f-464f-a345-be541e431169 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:56.799335 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e4360f94-341f-464f-a345-be541e431169 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.176087 May 27 09:40:56.799899 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 242/491] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:56 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:57.818728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-22dfa490-0d18-4a4f-bae4-2663d82efda9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:57.819500 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-22dfa490-0d18-4a4f-bae4-2663d82efda9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:57.826460 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-22dfa490-0d18-4a4f-bae4-2663d82efda9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:57.826938 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-22dfa490-0d18-4a4f-bae4-2663d82efda9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:57.827676 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-22dfa490-0d18-4a4f-bae4-2663d82efda9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:57.828109 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-22dfa490-0d18-4a4f-bae4-2663d82efda9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:57.997451 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-22dfa490-0d18-4a4f-bae4-2663d82efda9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:58.000274 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:40:58.008870 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-22dfa490-0d18-4a4f-bae4-2663d82efda9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:58.010663 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-22dfa490-0d18-4a4f-bae4-2663d82efda9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:58.012102 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-22dfa490-0d18-4a4f-bae4-2663d82efda9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.197478 May 27 09:40:58.019407 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 250/492] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:57 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:40:59.031720 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b7171cdf-1de4-4c33-9471-7cb26fa0f273 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:40:59.032312 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b7171cdf-1de4-4c33-9471-7cb26fa0f273 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:40:59.041033 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b7171cdf-1de4-4c33-9471-7cb26fa0f273 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:59.041526 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b7171cdf-1de4-4c33-9471-7cb26fa0f273 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:59.042370 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b7171cdf-1de4-4c33-9471-7cb26fa0f273 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:40:59.042808 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b7171cdf-1de4-4c33-9471-7cb26fa0f273 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:40:59.198846 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b7171cdf-1de4-4c33-9471-7cb26fa0f273 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:59.208652 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b7171cdf-1de4-4c33-9471-7cb26fa0f273 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:59.210159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b7171cdf-1de4-4c33-9471-7cb26fa0f273 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:40:59.211424 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b7171cdf-1de4-4c33-9471-7cb26fa0f273 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.184301 May 27 09:40:59.211995 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 243/493] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:40:59 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:41:00.234893 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4e8c69e0-7554-49fc-b6cb-17f594bf539d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:00.236256 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4e8c69e0-7554-49fc-b6cb-17f594bf539d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:00.239306 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=42 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:00.244918 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4e8c69e0-7554-49fc-b6cb-17f594bf539d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:00.245600 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4e8c69e0-7554-49fc-b6cb-17f594bf539d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:00.246604 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4e8c69e0-7554-49fc-b6cb-17f594bf539d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:00.253000 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4e8c69e0-7554-49fc-b6cb-17f594bf539d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:00.416138 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4e8c69e0-7554-49fc-b6cb-17f594bf539d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:00.427329 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4e8c69e0-7554-49fc-b6cb-17f594bf539d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:00.429038 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4e8c69e0-7554-49fc-b6cb-17f594bf539d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:00.430461 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4e8c69e0-7554-49fc-b6cb-17f594bf539d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.199281 May 27 09:41:00.460249 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 251/494] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:00 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:01.456533 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f96187b2-b3b4-41b9-ab47-b64bb65a4bd4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:01.458013 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f96187b2-b3b4-41b9-ab47-b64bb65a4bd4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:01.477978 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f96187b2-b3b4-41b9-ab47-b64bb65a4bd4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:01.478801 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f96187b2-b3b4-41b9-ab47-b64bb65a4bd4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:01.480384 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f96187b2-b3b4-41b9-ab47-b64bb65a4bd4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:01.481055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f96187b2-b3b4-41b9-ab47-b64bb65a4bd4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:01.964116 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f96187b2-b3b4-41b9-ab47-b64bb65a4bd4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:01.972848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f96187b2-b3b4-41b9-ab47-b64bb65a4bd4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:01.974389 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f96187b2-b3b4-41b9-ab47-b64bb65a4bd4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:01.975556 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f96187b2-b3b4-41b9-ab47-b64bb65a4bd4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.524584 May 27 09:41:01.976117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 244/495] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:01 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:02.999060 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b06454f9-8c88-4dfc-9bdc-d7d424f95e4e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:02.999802 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b06454f9-8c88-4dfc-9bdc-d7d424f95e4e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:03.006933 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b06454f9-8c88-4dfc-9bdc-d7d424f95e4e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:03.007548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b06454f9-8c88-4dfc-9bdc-d7d424f95e4e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:03.008543 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b06454f9-8c88-4dfc-9bdc-d7d424f95e4e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:03.009055 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b06454f9-8c88-4dfc-9bdc-d7d424f95e4e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:03.147355 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b06454f9-8c88-4dfc-9bdc-d7d424f95e4e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:03.154986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b06454f9-8c88-4dfc-9bdc-d7d424f95e4e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:03.156466 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b06454f9-8c88-4dfc-9bdc-d7d424f95e4e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:03.157640 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b06454f9-8c88-4dfc-9bdc-d7d424f95e4e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.163175 May 27 09:41:03.158217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 252/496] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:02 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:41:04.177008 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-725ed0f2-10d9-4e0f-95e6-7fc52588389b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:04.177631 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-725ed0f2-10d9-4e0f-95e6-7fc52588389b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:04.184651 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-725ed0f2-10d9-4e0f-95e6-7fc52588389b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:04.185094 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-725ed0f2-10d9-4e0f-95e6-7fc52588389b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:04.185862 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-725ed0f2-10d9-4e0f-95e6-7fc52588389b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:04.186327 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-725ed0f2-10d9-4e0f-95e6-7fc52588389b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:04.332426 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-725ed0f2-10d9-4e0f-95e6-7fc52588389b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:04.342598 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-725ed0f2-10d9-4e0f-95e6-7fc52588389b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:04.344325 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-725ed0f2-10d9-4e0f-95e6-7fc52588389b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:04.345821 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-725ed0f2-10d9-4e0f-95e6-7fc52588389b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.173104 May 27 09:41:04.347782 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 245/497] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:04 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:05.365235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0a3686f2-d796-4ab9-ace8-0bb230f0fbe0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:05.365917 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0a3686f2-d796-4ab9-ace8-0bb230f0fbe0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:05.373592 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0a3686f2-d796-4ab9-ace8-0bb230f0fbe0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:05.374043 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0a3686f2-d796-4ab9-ace8-0bb230f0fbe0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:05.374860 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0a3686f2-d796-4ab9-ace8-0bb230f0fbe0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:05.375303 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0a3686f2-d796-4ab9-ace8-0bb230f0fbe0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:05.518483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0a3686f2-d796-4ab9-ace8-0bb230f0fbe0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:05.527553 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0a3686f2-d796-4ab9-ace8-0bb230f0fbe0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:05.529168 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0a3686f2-d796-4ab9-ace8-0bb230f0fbe0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:05.530477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0a3686f2-d796-4ab9-ace8-0bb230f0fbe0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.169204 May 27 09:41:05.531126 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 253/498] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:05 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:41:06.549436 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0e710258-9bd5-4ca4-a769-9b8dd2c726bd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:06.550158 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0e710258-9bd5-4ca4-a769-9b8dd2c726bd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:06.556932 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0e710258-9bd5-4ca4-a769-9b8dd2c726bd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:06.557415 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0e710258-9bd5-4ca4-a769-9b8dd2c726bd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:06.558174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0e710258-9bd5-4ca4-a769-9b8dd2c726bd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:06.559220 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0e710258-9bd5-4ca4-a769-9b8dd2c726bd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:06.691565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0e710258-9bd5-4ca4-a769-9b8dd2c726bd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:06.700147 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0e710258-9bd5-4ca4-a769-9b8dd2c726bd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:06.701636 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0e710258-9bd5-4ca4-a769-9b8dd2c726bd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:06.702829 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0e710258-9bd5-4ca4-a769-9b8dd2c726bd tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.157278 May 27 09:41:06.703383 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 246/499] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:06 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:07.720966 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f1db332a-3bdc-447f-aca7-a965257ab500 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:07.721699 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f1db332a-3bdc-447f-aca7-a965257ab500 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:07.728463 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f1db332a-3bdc-447f-aca7-a965257ab500 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:07.728990 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f1db332a-3bdc-447f-aca7-a965257ab500 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:07.729781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f1db332a-3bdc-447f-aca7-a965257ab500 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:07.730243 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f1db332a-3bdc-447f-aca7-a965257ab500 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:07.873539 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f1db332a-3bdc-447f-aca7-a965257ab500 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:07.881960 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f1db332a-3bdc-447f-aca7-a965257ab500 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:07.883603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f1db332a-3bdc-447f-aca7-a965257ab500 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:07.884705 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f1db332a-3bdc-447f-aca7-a965257ab500 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.167769 May 27 09:41:07.885281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 254/500] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:07 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:08.908225 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fc8d6f9f-eeb4-442a-a981-eaa2ab1cff2a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:08.908862 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fc8d6f9f-eeb4-442a-a981-eaa2ab1cff2a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:08.915858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fc8d6f9f-eeb4-442a-a981-eaa2ab1cff2a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:08.916303 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fc8d6f9f-eeb4-442a-a981-eaa2ab1cff2a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:08.917067 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fc8d6f9f-eeb4-442a-a981-eaa2ab1cff2a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:08.917495 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fc8d6f9f-eeb4-442a-a981-eaa2ab1cff2a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:09.048315 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fc8d6f9f-eeb4-442a-a981-eaa2ab1cff2a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:09.059250 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fc8d6f9f-eeb4-442a-a981-eaa2ab1cff2a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:09.061031 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fc8d6f9f-eeb4-442a-a981-eaa2ab1cff2a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:09.061981 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fc8d6f9f-eeb4-442a-a981-eaa2ab1cff2a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.157653 May 27 09:41:09.062754 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 247/501] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:08 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:41:10.080607 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-33d06132-3477-41b1-ac84-685896c221b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:10.096384 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-33d06132-3477-41b1-ac84-685896c221b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:10.096384 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33d06132-3477-41b1-ac84-685896c221b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:10.096384 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33d06132-3477-41b1-ac84-685896c221b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:10.096384 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33d06132-3477-41b1-ac84-685896c221b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:10.096801 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33d06132-3477-41b1-ac84-685896c221b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:10.219117 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-33d06132-3477-41b1-ac84-685896c221b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:10.227658 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-33d06132-3477-41b1-ac84-685896c221b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:10.229220 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-33d06132-3477-41b1-ac84-685896c221b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:10.230511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-33d06132-3477-41b1-ac84-685896c221b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.153675 May 27 09:41:10.231034 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 255/502] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:10 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:11.249801 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-886aa211-4901-4aa6-99f5-3c4564588756 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:11.250441 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-886aa211-4901-4aa6-99f5-3c4564588756 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:11.257001 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-886aa211-4901-4aa6-99f5-3c4564588756 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:11.257453 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-886aa211-4901-4aa6-99f5-3c4564588756 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:11.258239 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-886aa211-4901-4aa6-99f5-3c4564588756 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:11.258680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-886aa211-4901-4aa6-99f5-3c4564588756 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:11.393347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-886aa211-4901-4aa6-99f5-3c4564588756 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:11.402030 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-886aa211-4901-4aa6-99f5-3c4564588756 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:11.404164 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-886aa211-4901-4aa6-99f5-3c4564588756 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:11.405384 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-886aa211-4901-4aa6-99f5-3c4564588756 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.160091 May 27 09:41:11.405930 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 248/503] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:11 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:12.435767 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4680c204-dfc9-4c3c-8223-1b80784f7df2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:12.436418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4680c204-dfc9-4c3c-8223-1b80784f7df2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:12.443171 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4680c204-dfc9-4c3c-8223-1b80784f7df2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:12.443626 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4680c204-dfc9-4c3c-8223-1b80784f7df2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:12.444391 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4680c204-dfc9-4c3c-8223-1b80784f7df2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:12.444833 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4680c204-dfc9-4c3c-8223-1b80784f7df2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:12.578853 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4680c204-dfc9-4c3c-8223-1b80784f7df2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:12.587407 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4680c204-dfc9-4c3c-8223-1b80784f7df2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:12.588919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4680c204-dfc9-4c3c-8223-1b80784f7df2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:12.590751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4680c204-dfc9-4c3c-8223-1b80784f7df2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.158872 May 27 09:41:12.591318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 256/504] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:12 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:13.609673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bcdeb633-582f-4a37-a4ea-2ec0d5a49e2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:13.610318 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bcdeb633-582f-4a37-a4ea-2ec0d5a49e2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:13.616994 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bcdeb633-582f-4a37-a4ea-2ec0d5a49e2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:13.617448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bcdeb633-582f-4a37-a4ea-2ec0d5a49e2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:13.618234 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bcdeb633-582f-4a37-a4ea-2ec0d5a49e2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:13.618684 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bcdeb633-582f-4a37-a4ea-2ec0d5a49e2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:13.749483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bcdeb633-582f-4a37-a4ea-2ec0d5a49e2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:13.757980 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bcdeb633-582f-4a37-a4ea-2ec0d5a49e2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:13.759572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bcdeb633-582f-4a37-a4ea-2ec0d5a49e2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:13.760732 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bcdeb633-582f-4a37-a4ea-2ec0d5a49e2b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.155522 May 27 09:41:13.761289 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 249/505] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:13 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:14.778997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-343a3284-c6e8-471c-ab43-736af9ee2235 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:14.779636 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-343a3284-c6e8-471c-ab43-736af9ee2235 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:14.786044 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-343a3284-c6e8-471c-ab43-736af9ee2235 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:14.786521 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-343a3284-c6e8-471c-ab43-736af9ee2235 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:14.787284 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-343a3284-c6e8-471c-ab43-736af9ee2235 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:14.787722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-343a3284-c6e8-471c-ab43-736af9ee2235 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:14.922264 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-343a3284-c6e8-471c-ab43-736af9ee2235 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:14.931098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-343a3284-c6e8-471c-ab43-736af9ee2235 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:14.932598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-343a3284-c6e8-471c-ab43-736af9ee2235 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:14.933762 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-343a3284-c6e8-471c-ab43-736af9ee2235 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.158734 May 27 09:41:14.934350 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 257/506] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:14 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:15.951762 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-dd12e791-0915-4287-9745-334c348ad5e3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:15.952292 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-dd12e791-0915-4287-9745-334c348ad5e3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:15.959186 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dd12e791-0915-4287-9745-334c348ad5e3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:15.959637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dd12e791-0915-4287-9745-334c348ad5e3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:15.960434 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dd12e791-0915-4287-9745-334c348ad5e3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:15.960864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dd12e791-0915-4287-9745-334c348ad5e3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:16.094705 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-dd12e791-0915-4287-9745-334c348ad5e3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:16.103239 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-dd12e791-0915-4287-9745-334c348ad5e3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:16.104725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-dd12e791-0915-4287-9745-334c348ad5e3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:16.105945 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-dd12e791-0915-4287-9745-334c348ad5e3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.158170 May 27 09:41:16.106558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 250/507] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:15 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:17.124927 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-42a5415c-59ce-4165-be4d-88efb5fe3447 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:17.125585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-42a5415c-59ce-4165-be4d-88efb5fe3447 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:17.132151 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-42a5415c-59ce-4165-be4d-88efb5fe3447 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:17.132592 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-42a5415c-59ce-4165-be4d-88efb5fe3447 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:17.133355 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-42a5415c-59ce-4165-be4d-88efb5fe3447 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:17.133859 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-42a5415c-59ce-4165-be4d-88efb5fe3447 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:17.273020 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-42a5415c-59ce-4165-be4d-88efb5fe3447 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:17.282422 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-42a5415c-59ce-4165-be4d-88efb5fe3447 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:17.283933 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-42a5415c-59ce-4165-be4d-88efb5fe3447 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:17.285155 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-42a5415c-59ce-4165-be4d-88efb5fe3447 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.164741 May 27 09:41:17.285713 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 258/508] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:17 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:18.304639 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-48d6979c-e101-4fdd-9723-976365731c40 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:18.305281 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-48d6979c-e101-4fdd-9723-976365731c40 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:18.312660 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-48d6979c-e101-4fdd-9723-976365731c40 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:18.313112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-48d6979c-e101-4fdd-9723-976365731c40 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:18.313882 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-48d6979c-e101-4fdd-9723-976365731c40 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:18.314359 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-48d6979c-e101-4fdd-9723-976365731c40 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:18.446301 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-48d6979c-e101-4fdd-9723-976365731c40 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:18.455124 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-48d6979c-e101-4fdd-9723-976365731c40 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:18.456637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-48d6979c-e101-4fdd-9723-976365731c40 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:18.457837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-48d6979c-e101-4fdd-9723-976365731c40 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.157436 May 27 09:41:18.458431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 251/509] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:18 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:19.477045 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a02f371f-c6a4-475f-8dcc-32f3e4102e2e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:19.477659 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a02f371f-c6a4-475f-8dcc-32f3e4102e2e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:19.484268 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a02f371f-c6a4-475f-8dcc-32f3e4102e2e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:19.484723 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a02f371f-c6a4-475f-8dcc-32f3e4102e2e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:19.485518 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a02f371f-c6a4-475f-8dcc-32f3e4102e2e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:19.485958 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a02f371f-c6a4-475f-8dcc-32f3e4102e2e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:19.635815 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a02f371f-c6a4-475f-8dcc-32f3e4102e2e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:19.648697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a02f371f-c6a4-475f-8dcc-32f3e4102e2e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:19.650672 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a02f371f-c6a4-475f-8dcc-32f3e4102e2e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:19.651849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a02f371f-c6a4-475f-8dcc-32f3e4102e2e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.178887 May 27 09:41:19.652409 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 259/510] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:19 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:20.670557 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-83e2f415-7431-4a90-bc00-9f9c522caa7d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:20.671100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-83e2f415-7431-4a90-bc00-9f9c522caa7d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:20.677941 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-83e2f415-7431-4a90-bc00-9f9c522caa7d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:20.678438 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-83e2f415-7431-4a90-bc00-9f9c522caa7d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:20.679212 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-83e2f415-7431-4a90-bc00-9f9c522caa7d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:20.681693 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-83e2f415-7431-4a90-bc00-9f9c522caa7d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:20.813459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-83e2f415-7431-4a90-bc00-9f9c522caa7d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:20.822159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-83e2f415-7431-4a90-bc00-9f9c522caa7d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:20.823684 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-83e2f415-7431-4a90-bc00-9f9c522caa7d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:20.824847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-83e2f415-7431-4a90-bc00-9f9c522caa7d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.158621 May 27 09:41:20.825589 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 252/511] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:20 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:21.677056 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-177c3f22-74ce-421a-ab09-9a19d6bc4957 req-d674c2fd-d366-4164-9820-fc26758670b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f38432-87c8-46fe-b6fe-4795162677ca", "name": "network-vif-plugged", "status": "completed", "tag": "791d9d86-9101-48e0-92fa-96a2b245c1d6"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:41:21.686276 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-177c3f22-74ce-421a-ab09-9a19d6bc4957 req-d674c2fd-d366-4164-9820-fc26758670b5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:21.686727 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-177c3f22-74ce-421a-ab09-9a19d6bc4957 req-d674c2fd-d366-4164-9820-fc26758670b5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:21.698560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-177c3f22-74ce-421a-ab09-9a19d6bc4957 req-d674c2fd-d366-4164-9820-fc26758670b5 service nova] Creating event network-vif-plugged:791d9d86-9101-48e0-92fa-96a2b245c1d6 for instance 68f38432-87c8-46fe-b6fe-4795162677ca on hv-cinder-82549 May 27 09:41:21.704160 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-177c3f22-74ce-421a-ab09-9a19d6bc4957 req-d674c2fd-d366-4164-9820-fc26758670b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031103 May 27 09:41:21.704770 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 260/512] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:41:21.844454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0ee01a71-1b6c-42c0-a57a-33570c0cb356 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:21.845097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0ee01a71-1b6c-42c0-a57a-33570c0cb356 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:21.851503 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0ee01a71-1b6c-42c0-a57a-33570c0cb356 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:21.852097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0ee01a71-1b6c-42c0-a57a-33570c0cb356 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:21.852745 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0ee01a71-1b6c-42c0-a57a-33570c0cb356 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:21.853177 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0ee01a71-1b6c-42c0-a57a-33570c0cb356 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:22.003180 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0ee01a71-1b6c-42c0-a57a-33570c0cb356 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:22.012480 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0ee01a71-1b6c-42c0-a57a-33570c0cb356 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:22.014551 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0ee01a71-1b6c-42c0-a57a-33570c0cb356 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:22.015798 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0ee01a71-1b6c-42c0-a57a-33570c0cb356 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.175908 May 27 09:41:22.016351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 253/513] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:21 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:23.036121 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-057c3d16-aed7-4d69-a502-3969e8f8d6f6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:23.036920 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-057c3d16-aed7-4d69-a502-3969e8f8d6f6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:23.043868 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-057c3d16-aed7-4d69-a502-3969e8f8d6f6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:23.044328 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-057c3d16-aed7-4d69-a502-3969e8f8d6f6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:23.045122 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-057c3d16-aed7-4d69-a502-3969e8f8d6f6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:23.045677 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-057c3d16-aed7-4d69-a502-3969e8f8d6f6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:23.215365 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-057c3d16-aed7-4d69-a502-3969e8f8d6f6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:23.224222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-057c3d16-aed7-4d69-a502-3969e8f8d6f6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:23.225777 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-057c3d16-aed7-4d69-a502-3969e8f8d6f6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:23.227469 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-057c3d16-aed7-4d69-a502-3969e8f8d6f6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.196037 May 27 09:41:23.227722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 261/514] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:23 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:24.245838 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f6146824-2a83-4cc3-bbfb-1ba3118fdb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:24.246481 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f6146824-2a83-4cc3-bbfb-1ba3118fdb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:24.248925 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=28 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:24.253889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f6146824-2a83-4cc3-bbfb-1ba3118fdb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:24.254379 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f6146824-2a83-4cc3-bbfb-1ba3118fdb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:24.255168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f6146824-2a83-4cc3-bbfb-1ba3118fdb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:24.255848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f6146824-2a83-4cc3-bbfb-1ba3118fdb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:24.258528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=88 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:24.402110 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f6146824-2a83-4cc3-bbfb-1ba3118fdb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:24.411784 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f6146824-2a83-4cc3-bbfb-1ba3118fdb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:24.413287 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f6146824-2a83-4cc3-bbfb-1ba3118fdb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:24.417341 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f6146824-2a83-4cc3-bbfb-1ba3118fdb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.172682 May 27 09:41:24.417341 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 254/515] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:24 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:25.433381 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f840e36f-a8a4-40de-8ee5-0d8459784bf9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:25.434234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f840e36f-a8a4-40de-8ee5-0d8459784bf9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:25.440779 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f840e36f-a8a4-40de-8ee5-0d8459784bf9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:25.441226 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f840e36f-a8a4-40de-8ee5-0d8459784bf9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:25.441996 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f840e36f-a8a4-40de-8ee5-0d8459784bf9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:25.442457 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f840e36f-a8a4-40de-8ee5-0d8459784bf9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:25.596941 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f840e36f-a8a4-40de-8ee5-0d8459784bf9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:25.606243 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f840e36f-a8a4-40de-8ee5-0d8459784bf9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:25.610643 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f840e36f-a8a4-40de-8ee5-0d8459784bf9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:25.610643 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f840e36f-a8a4-40de-8ee5-0d8459784bf9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1808 microversion: 2.20 time: 0.180042 May 27 09:41:25.610643 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 262/516] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:25 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:26.627722 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2434620e-5038-4f3e-8b00-6395ace91cdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:26.628355 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2434620e-5038-4f3e-8b00-6395ace91cdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:26.635407 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2434620e-5038-4f3e-8b00-6395ace91cdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:26.635853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2434620e-5038-4f3e-8b00-6395ace91cdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:26.636613 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2434620e-5038-4f3e-8b00-6395ace91cdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:26.637043 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2434620e-5038-4f3e-8b00-6395ace91cdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:26.964363 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2434620e-5038-4f3e-8b00-6395ace91cdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:26.974284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2434620e-5038-4f3e-8b00-6395ace91cdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:26.975788 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2434620e-5038-4f3e-8b00-6395ace91cdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:26.976959 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2434620e-5038-4f3e-8b00-6395ace91cdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1795 microversion: 2.20 time: 0.353641 May 27 09:41:26.977523 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 255/517] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:41:26 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1795 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:41:40.803050 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=23 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:40.803793 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=69 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:40.910378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c7d199fd-9ca3-4a90-be53-6af42ebdd547 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:40.910967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c7d199fd-9ca3-4a90-be53-6af42ebdd547 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:40.921009 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7d199fd-9ca3-4a90-be53-6af42ebdd547 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:40.921824 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7d199fd-9ca3-4a90-be53-6af42ebdd547 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:40.923181 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7d199fd-9ca3-4a90-be53-6af42ebdd547 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:40.923918 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7d199fd-9ca3-4a90-be53-6af42ebdd547 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:41.195695 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-c7d199fd-9ca3-4a90-be53-6af42ebdd547 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lazy-loading 'services' on Instance uuid 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:41:41.595612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c7d199fd-9ca3-4a90-be53-6af42ebdd547 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/os-volume_attachments/c2f4fd66-4c5a-4b54-8abb-4f586f9be570" status: 202 len: 0 microversion: 2.1 time: 0.797854 May 27 09:41:41.596209 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 263/518] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:41:40 2022] DELETE /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/os-volume_attachments/c2f4fd66-4c5a-4b54-8abb-4f586f9be570 => generated 0 bytes in 799 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:41:43.789782 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9cc009d3-7a1d-4db4-98bf-cf530bd374e4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:41:43.793960 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:43.794646 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=11 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:41:43.799609 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9cc009d3-7a1d-4db4-98bf-cf530bd374e4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:43.800077 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9cc009d3-7a1d-4db4-98bf-cf530bd374e4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:43.824474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9cc009d3-7a1d-4db4-98bf-cf530bd374e4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Going to try to stop instance {{(pid=124828) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 27 09:41:44.124749 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9cc009d3-7a1d-4db4-98bf-cf530bd374e4 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/action" status: 202 len: 0 microversion: 2.1 time: 0.338742 May 27 09:41:44.125877 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 256/519] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:41:43 2022] POST /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/action => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:41:44.135786 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-74e0679c-1830-453c-8332-3ae2c05c3d58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:44.136612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-74e0679c-1830-453c-8332-3ae2c05c3d58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:44.144479 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74e0679c-1830-453c-8332-3ae2c05c3d58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:44.145167 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74e0679c-1830-453c-8332-3ae2c05c3d58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:44.145760 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74e0679c-1830-453c-8332-3ae2c05c3d58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:44.146210 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74e0679c-1830-453c-8332-3ae2c05c3d58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:44.283095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-74e0679c-1830-453c-8332-3ae2c05c3d58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:44.297157 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-74e0679c-1830-453c-8332-3ae2c05c3d58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.159886 May 27 09:41:44.297157 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 264/520] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:44 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:45.309918 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b2cf9ce0-c753-4d5c-9342-cc760afaf228 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:45.310648 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b2cf9ce0-c753-4d5c-9342-cc760afaf228 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:45.317016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2cf9ce0-c753-4d5c-9342-cc760afaf228 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:45.317462 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2cf9ce0-c753-4d5c-9342-cc760afaf228 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:45.318257 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2cf9ce0-c753-4d5c-9342-cc760afaf228 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:45.318699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b2cf9ce0-c753-4d5c-9342-cc760afaf228 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:45.452977 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b2cf9ce0-c753-4d5c-9342-cc760afaf228 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:45.461266 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b2cf9ce0-c753-4d5c-9342-cc760afaf228 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.156057 May 27 09:41:45.461845 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 257/521] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:45 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:46.479873 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-661068fb-5039-40ca-b80f-75ffc30e2b3e tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:46.480469 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-661068fb-5039-40ca-b80f-75ffc30e2b3e tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:46.487748 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-661068fb-5039-40ca-b80f-75ffc30e2b3e tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:46.488240 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-661068fb-5039-40ca-b80f-75ffc30e2b3e tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:46.489029 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-661068fb-5039-40ca-b80f-75ffc30e2b3e tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:46.489501 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-661068fb-5039-40ca-b80f-75ffc30e2b3e tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:46.655954 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-661068fb-5039-40ca-b80f-75ffc30e2b3e tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:46.665090 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-661068fb-5039-40ca-b80f-75ffc30e2b3e tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.189366 May 27 09:41:46.665811 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 265/522] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:46 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:47.684019 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8ac66bc7-dd27-484f-a896-eaaa238b063d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:47.684638 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8ac66bc7-dd27-484f-a896-eaaa238b063d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:47.691439 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8ac66bc7-dd27-484f-a896-eaaa238b063d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.691893 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8ac66bc7-dd27-484f-a896-eaaa238b063d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.692677 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8ac66bc7-dd27-484f-a896-eaaa238b063d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:47.693125 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8ac66bc7-dd27-484f-a896-eaaa238b063d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:47.838358 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8ac66bc7-dd27-484f-a896-eaaa238b063d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:47.846323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8ac66bc7-dd27-484f-a896-eaaa238b063d tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.166105 May 27 09:41:47.846903 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 258/523] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:47 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:48.864227 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-33f07ce3-6d87-42fe-91e2-1039e9db1831 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:48.864772 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-33f07ce3-6d87-42fe-91e2-1039e9db1831 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:48.871245 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33f07ce3-6d87-42fe-91e2-1039e9db1831 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:48.871688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33f07ce3-6d87-42fe-91e2-1039e9db1831 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:48.872457 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33f07ce3-6d87-42fe-91e2-1039e9db1831 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:48.872896 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33f07ce3-6d87-42fe-91e2-1039e9db1831 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:49.013752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-33f07ce3-6d87-42fe-91e2-1039e9db1831 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:49.025335 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-33f07ce3-6d87-42fe-91e2-1039e9db1831 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.165772 May 27 09:41:49.025927 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 266/524] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:48 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:50.043868 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7bf5c785-82df-4cf5-ba9b-064cfb30fadd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:50.044835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7bf5c785-82df-4cf5-ba9b-064cfb30fadd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:50.051693 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7bf5c785-82df-4cf5-ba9b-064cfb30fadd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:50.052142 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7bf5c785-82df-4cf5-ba9b-064cfb30fadd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:50.052920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7bf5c785-82df-4cf5-ba9b-064cfb30fadd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:50.053354 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7bf5c785-82df-4cf5-ba9b-064cfb30fadd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:50.199619 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7bf5c785-82df-4cf5-ba9b-064cfb30fadd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:50.208169 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7bf5c785-82df-4cf5-ba9b-064cfb30fadd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.168351 May 27 09:41:50.208760 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 259/525] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:50 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:51.225267 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1eac2e93-87e0-4646-98f6-954c69a4ff4b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:51.225820 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1eac2e93-87e0-4646-98f6-954c69a4ff4b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:51.232473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1eac2e93-87e0-4646-98f6-954c69a4ff4b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:51.232917 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1eac2e93-87e0-4646-98f6-954c69a4ff4b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:51.233678 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1eac2e93-87e0-4646-98f6-954c69a4ff4b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:51.234112 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1eac2e93-87e0-4646-98f6-954c69a4ff4b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:51.370120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1eac2e93-87e0-4646-98f6-954c69a4ff4b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:51.378957 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1eac2e93-87e0-4646-98f6-954c69a4ff4b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.157381 May 27 09:41:51.379194 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 267/526] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:51 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:52.396385 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0290e200-99c2-4c23-affa-ac31a5998b1a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:52.397013 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0290e200-99c2-4c23-affa-ac31a5998b1a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:52.403899 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0290e200-99c2-4c23-affa-ac31a5998b1a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:52.404354 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0290e200-99c2-4c23-affa-ac31a5998b1a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:52.405143 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0290e200-99c2-4c23-affa-ac31a5998b1a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:52.405578 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0290e200-99c2-4c23-affa-ac31a5998b1a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:52.545090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0290e200-99c2-4c23-affa-ac31a5998b1a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:52.555266 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0290e200-99c2-4c23-affa-ac31a5998b1a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.162768 May 27 09:41:52.555839 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 260/527] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:52 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:53.573127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f84ffe22-307e-4718-9022-2d076f3ad0ff tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:53.573740 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f84ffe22-307e-4718-9022-2d076f3ad0ff tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:53.580470 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f84ffe22-307e-4718-9022-2d076f3ad0ff tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:53.580923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f84ffe22-307e-4718-9022-2d076f3ad0ff tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:53.581687 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f84ffe22-307e-4718-9022-2d076f3ad0ff tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:53.582121 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f84ffe22-307e-4718-9022-2d076f3ad0ff tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:53.721788 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f84ffe22-307e-4718-9022-2d076f3ad0ff tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:53.729836 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f84ffe22-307e-4718-9022-2d076f3ad0ff tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.160476 May 27 09:41:53.730502 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 268/528] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:53 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:54.749889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6e0ad92b-cadb-4a97-a30d-339f7e9ca3c9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:54.750510 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6e0ad92b-cadb-4a97-a30d-339f7e9ca3c9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:54.757207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6e0ad92b-cadb-4a97-a30d-339f7e9ca3c9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:54.757650 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6e0ad92b-cadb-4a97-a30d-339f7e9ca3c9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:54.758427 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6e0ad92b-cadb-4a97-a30d-339f7e9ca3c9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:54.758862 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6e0ad92b-cadb-4a97-a30d-339f7e9ca3c9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:54.891280 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6e0ad92b-cadb-4a97-a30d-339f7e9ca3c9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:54.898970 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6e0ad92b-cadb-4a97-a30d-339f7e9ca3c9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.152891 May 27 09:41:54.899540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 261/529] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:54 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:55.917267 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7ef3a542-a5ea-4764-9ca8-fb1c20667db1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:55.917916 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7ef3a542-a5ea-4764-9ca8-fb1c20667db1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:55.924982 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ef3a542-a5ea-4764-9ca8-fb1c20667db1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:55.925696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ef3a542-a5ea-4764-9ca8-fb1c20667db1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:55.926521 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ef3a542-a5ea-4764-9ca8-fb1c20667db1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:55.926967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ef3a542-a5ea-4764-9ca8-fb1c20667db1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:56.068610 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7ef3a542-a5ea-4764-9ca8-fb1c20667db1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:56.076774 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7ef3a542-a5ea-4764-9ca8-fb1c20667db1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.163345 May 27 09:41:56.077271 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 269/530] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:55 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:41:57.100716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-68fdde91-87c4-4541-84ba-cbe8b6503f45 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:57.101361 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-68fdde91-87c4-4541-84ba-cbe8b6503f45 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:57.107919 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-68fdde91-87c4-4541-84ba-cbe8b6503f45 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:57.108377 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-68fdde91-87c4-4541-84ba-cbe8b6503f45 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:57.109155 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-68fdde91-87c4-4541-84ba-cbe8b6503f45 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:57.109594 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-68fdde91-87c4-4541-84ba-cbe8b6503f45 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:57.253333 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-68fdde91-87c4-4541-84ba-cbe8b6503f45 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:57.261260 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-68fdde91-87c4-4541-84ba-cbe8b6503f45 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.170106 May 27 09:41:57.261853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 262/531] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:57 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:58.282145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-31bc69d5-5295-427c-905e-c4c8579ee0dd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:58.283154 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-31bc69d5-5295-427c-905e-c4c8579ee0dd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:58.293195 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-31bc69d5-5295-427c-905e-c4c8579ee0dd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:58.293698 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-31bc69d5-5295-427c-905e-c4c8579ee0dd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:58.294660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-31bc69d5-5295-427c-905e-c4c8579ee0dd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:58.295118 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-31bc69d5-5295-427c-905e-c4c8579ee0dd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:58.462052 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-31bc69d5-5295-427c-905e-c4c8579ee0dd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:58.470511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-31bc69d5-5295-427c-905e-c4c8579ee0dd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.194330 May 27 09:41:58.471092 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 270/532] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:58 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:41:59.488743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-768afa5b-2811-413f-a813-762daed18bc8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:41:59.489609 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-768afa5b-2811-413f-a813-762daed18bc8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:41:59.496453 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-768afa5b-2811-413f-a813-762daed18bc8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:59.496911 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-768afa5b-2811-413f-a813-762daed18bc8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:59.497723 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-768afa5b-2811-413f-a813-762daed18bc8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:41:59.498131 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-768afa5b-2811-413f-a813-762daed18bc8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:41:59.649282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-768afa5b-2811-413f-a813-762daed18bc8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:41:59.657553 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-768afa5b-2811-413f-a813-762daed18bc8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1676 microversion: 2.1 time: 0.173241 May 27 09:41:59.658157 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 263/533] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:41:59 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1676 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:00.675674 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e1ad5f41-1d7b-4fcf-a9d0-73998dcd9da5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:00.676324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e1ad5f41-1d7b-4fcf-a9d0-73998dcd9da5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:00.683149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e1ad5f41-1d7b-4fcf-a9d0-73998dcd9da5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:00.683602 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e1ad5f41-1d7b-4fcf-a9d0-73998dcd9da5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:00.684380 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e1ad5f41-1d7b-4fcf-a9d0-73998dcd9da5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:00.684815 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e1ad5f41-1d7b-4fcf-a9d0-73998dcd9da5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:00.853585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e1ad5f41-1d7b-4fcf-a9d0-73998dcd9da5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:00.862147 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e1ad5f41-1d7b-4fcf-a9d0-73998dcd9da5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1653 microversion: 2.1 time: 0.190524 May 27 09:42:00.862783 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 271/534] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:00 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1653 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:00.880715 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-aeafad02-f9d2-486f-8fcf-59b2443b2dac tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:00.887784 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aeafad02-f9d2-486f-8fcf-59b2443b2dac tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:00.888233 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aeafad02-f9d2-486f-8fcf-59b2443b2dac tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:00.912867 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-aeafad02-f9d2-486f-8fcf-59b2443b2dac tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Going to try to start instance {{(pid=124828) start /opt/stack/nova/nova/compute/api.py:2730}} May 27 09:42:01.167362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-aeafad02-f9d2-486f-8fcf-59b2443b2dac tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/action" status: 202 len: 0 microversion: 2.1 time: 0.290371 May 27 09:42:01.167854 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 264/535] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:42:00 2022] POST /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:42:01.176867 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f0a470dc-c639-41a4-b68c-3e318b25e8f8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:01.177491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f0a470dc-c639-41a4-b68c-3e318b25e8f8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:01.184073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f0a470dc-c639-41a4-b68c-3e318b25e8f8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:01.184526 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f0a470dc-c639-41a4-b68c-3e318b25e8f8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:01.185308 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f0a470dc-c639-41a4-b68c-3e318b25e8f8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:01.185824 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f0a470dc-c639-41a4-b68c-3e318b25e8f8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:01.329102 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f0a470dc-c639-41a4-b68c-3e318b25e8f8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:01.338365 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f0a470dc-c639-41a4-b68c-3e318b25e8f8 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1662 microversion: 2.1 time: 0.165848 May 27 09:42:01.338958 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 272/536] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:01 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1662 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:02.365418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9e76ef7f-152f-4860-b329-d06d6fde17e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:02.366168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9e76ef7f-152f-4860-b329-d06d6fde17e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:02.372807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9e76ef7f-152f-4860-b329-d06d6fde17e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:02.373289 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9e76ef7f-152f-4860-b329-d06d6fde17e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:02.374039 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9e76ef7f-152f-4860-b329-d06d6fde17e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:02.374502 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9e76ef7f-152f-4860-b329-d06d6fde17e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:02.517550 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9e76ef7f-152f-4860-b329-d06d6fde17e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:02.525580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9e76ef7f-152f-4860-b329-d06d6fde17e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1662 microversion: 2.1 time: 0.165245 May 27 09:42:02.526091 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 265/537] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:02 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1662 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:03.551512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e68fc8a6-0b22-40b8-b66e-a5c7766d2544 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:03.552115 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e68fc8a6-0b22-40b8-b66e-a5c7766d2544 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:03.558769 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e68fc8a6-0b22-40b8-b66e-a5c7766d2544 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:03.559215 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e68fc8a6-0b22-40b8-b66e-a5c7766d2544 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:03.559986 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e68fc8a6-0b22-40b8-b66e-a5c7766d2544 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:03.560411 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e68fc8a6-0b22-40b8-b66e-a5c7766d2544 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:03.698429 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e68fc8a6-0b22-40b8-b66e-a5c7766d2544 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:03.705869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e68fc8a6-0b22-40b8-b66e-a5c7766d2544 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1666 microversion: 2.1 time: 0.158998 May 27 09:42:03.706468 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 273/538] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:03 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:15.116193 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2162827f-4b80-4a9b-b0f9-a647bf923110 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19ae7cb2-6ed6-4279-94fd-9b0b4a9ce6fd"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:15.117317 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2162827f-4b80-4a9b-b0f9-a647bf923110 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:15.119982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=20 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:15.120657 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:15.126284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2162827f-4b80-4a9b-b0f9-a647bf923110 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:15.136224 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2162827f-4b80-4a9b-b0f9-a647bf923110 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:15.136224 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2162827f-4b80-4a9b-b0f9-a647bf923110 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:15.136224 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2162827f-4b80-4a9b-b0f9-a647bf923110 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:15.964875 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2162827f-4b80-4a9b-b0f9-a647bf923110 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852544 May 27 09:42:15.965667 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 266/539] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:42:15 2022] POST /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:24.541099 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8919a4fe-1b6c-4942-9f9d-2547a970f79c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:24.542110 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8919a4fe-1b6c-4942-9f9d-2547a970f79c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:24.544587 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=22 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:24.545248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:24.550478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8919a4fe-1b6c-4942-9f9d-2547a970f79c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:24.550930 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8919a4fe-1b6c-4942-9f9d-2547a970f79c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:24.551704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8919a4fe-1b6c-4942-9f9d-2547a970f79c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:24.552144 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8919a4fe-1b6c-4942-9f9d-2547a970f79c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:24.577334 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-8919a4fe-1b6c-4942-9f9d-2547a970f79c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lazy-loading 'flavor' on Instance uuid 28b03ea7-b697-47df-898f-33d7f45ab279 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:24.996610 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8919a4fe-1b6c-4942-9f9d-2547a970f79c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/action" status: 200 len: 32 microversion: 2.1 time: 0.459501 May 27 09:42:24.997233 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 274/540] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:42:24 2022] POST /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:42:25.008241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a7f58f28-0874-4775-a556-1cbb1d66c9cd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:25.009638 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a7f58f28-0874-4775-a556-1cbb1d66c9cd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:25.015852 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a7f58f28-0874-4775-a556-1cbb1d66c9cd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:25.016608 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a7f58f28-0874-4775-a556-1cbb1d66c9cd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:25.017384 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a7f58f28-0874-4775-a556-1cbb1d66c9cd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:25.017856 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a7f58f28-0874-4775-a556-1cbb1d66c9cd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:25.161614 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a7f58f28-0874-4775-a556-1cbb1d66c9cd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:25.170174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a7f58f28-0874-4775-a556-1cbb1d66c9cd tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.166694 May 27 09:42:25.170782 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 267/541] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:25 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:26.195800 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-12e4f236-6b4a-49ba-af09-62e5d73552ca tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:26.196430 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-12e4f236-6b4a-49ba-af09-62e5d73552ca tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:26.202739 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-12e4f236-6b4a-49ba-af09-62e5d73552ca tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:26.203191 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-12e4f236-6b4a-49ba-af09-62e5d73552ca tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:26.203948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-12e4f236-6b4a-49ba-af09-62e5d73552ca tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:26.204381 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-12e4f236-6b4a-49ba-af09-62e5d73552ca tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:26.339130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-12e4f236-6b4a-49ba-af09-62e5d73552ca tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:26.347121 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-12e4f236-6b4a-49ba-af09-62e5d73552ca tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.156054 May 27 09:42:26.347680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 275/542] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:26 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:27.364476 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-80ad4c32-6e3c-4065-a4ea-335c5bc09628 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:27.365034 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-80ad4c32-6e3c-4065-a4ea-335c5bc09628 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:27.371608 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-80ad4c32-6e3c-4065-a4ea-335c5bc09628 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:27.372124 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-80ad4c32-6e3c-4065-a4ea-335c5bc09628 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:27.372971 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-80ad4c32-6e3c-4065-a4ea-335c5bc09628 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:27.373450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-80ad4c32-6e3c-4065-a4ea-335c5bc09628 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:27.502646 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-80ad4c32-6e3c-4065-a4ea-335c5bc09628 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:27.510652 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-80ad4c32-6e3c-4065-a4ea-335c5bc09628 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.150097 May 27 09:42:27.511215 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 268/543] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:27 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:28.528387 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-047671e2-0397-46de-be48-220e39746b78 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:28.528993 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-047671e2-0397-46de-be48-220e39746b78 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:28.536136 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-047671e2-0397-46de-be48-220e39746b78 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:28.536524 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-047671e2-0397-46de-be48-220e39746b78 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:28.537290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-047671e2-0397-46de-be48-220e39746b78 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:28.538161 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-047671e2-0397-46de-be48-220e39746b78 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:28.743941 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-047671e2-0397-46de-be48-220e39746b78 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:28.754023 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-047671e2-0397-46de-be48-220e39746b78 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.229483 May 27 09:42:28.754636 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 276/544] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:28 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:29.771465 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-50d5cd7b-a6ee-4c41-8ba6-4c11b0858989 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:29.772113 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-50d5cd7b-a6ee-4c41-8ba6-4c11b0858989 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:29.778816 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-50d5cd7b-a6ee-4c41-8ba6-4c11b0858989 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:29.779264 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-50d5cd7b-a6ee-4c41-8ba6-4c11b0858989 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:29.780035 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-50d5cd7b-a6ee-4c41-8ba6-4c11b0858989 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:29.780465 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-50d5cd7b-a6ee-4c41-8ba6-4c11b0858989 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:29.916583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-50d5cd7b-a6ee-4c41-8ba6-4c11b0858989 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:29.925899 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-50d5cd7b-a6ee-4c41-8ba6-4c11b0858989 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.158400 May 27 09:42:29.929764 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 269/545] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:29 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:30.944667 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7555370d-0d6a-4d12-bd2b-94b3503cbbc0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:30.945224 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7555370d-0d6a-4d12-bd2b-94b3503cbbc0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:30.951955 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7555370d-0d6a-4d12-bd2b-94b3503cbbc0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:30.952407 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7555370d-0d6a-4d12-bd2b-94b3503cbbc0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:30.953181 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7555370d-0d6a-4d12-bd2b-94b3503cbbc0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:30.953621 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7555370d-0d6a-4d12-bd2b-94b3503cbbc0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:31.090693 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7555370d-0d6a-4d12-bd2b-94b3503cbbc0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:31.099822 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7555370d-0d6a-4d12-bd2b-94b3503cbbc0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.159128 May 27 09:42:31.100417 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 277/546] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:30 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:32.117587 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d58fa7c2-50c9-445a-847e-93aba6f7e988 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:32.118188 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d58fa7c2-50c9-445a-847e-93aba6f7e988 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:32.124677 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d58fa7c2-50c9-445a-847e-93aba6f7e988 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:32.125730 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d58fa7c2-50c9-445a-847e-93aba6f7e988 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:32.126532 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d58fa7c2-50c9-445a-847e-93aba6f7e988 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:32.126969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d58fa7c2-50c9-445a-847e-93aba6f7e988 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:32.256563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d58fa7c2-50c9-445a-847e-93aba6f7e988 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:32.265105 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d58fa7c2-50c9-445a-847e-93aba6f7e988 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.151254 May 27 09:42:32.266606 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 270/547] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:32 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:33.281917 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-14ec7ac6-135c-4a1d-948d-23e0985062d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:33.286565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-14ec7ac6-135c-4a1d-948d-23e0985062d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:33.289173 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-14ec7ac6-135c-4a1d-948d-23e0985062d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:33.289610 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-14ec7ac6-135c-4a1d-948d-23e0985062d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:33.290403 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-14ec7ac6-135c-4a1d-948d-23e0985062d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:33.290831 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-14ec7ac6-135c-4a1d-948d-23e0985062d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:33.424077 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-14ec7ac6-135c-4a1d-948d-23e0985062d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:33.432499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-14ec7ac6-135c-4a1d-948d-23e0985062d6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.154488 May 27 09:42:33.433084 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 278/548] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:33 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:34.038361 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-727c80ea-08a2-4c02-80c6-b392f962026a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:34.038907 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-727c80ea-08a2-4c02-80c6-b392f962026a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:34.044841 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-727c80ea-08a2-4c02-80c6-b392f962026a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:34.045283 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-727c80ea-08a2-4c02-80c6-b392f962026a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:34.046038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-727c80ea-08a2-4c02-80c6-b392f962026a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:34.046499 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-727c80ea-08a2-4c02-80c6-b392f962026a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:34.078889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-727c80ea-08a2-4c02-80c6-b392f962026a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments/23ce0804-3c30-4060-b376-be478f79999c" status: 200 len: 194 microversion: 2.20 time: 0.150570 May 27 09:42:34.079460 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 271/549] 10.222.0.48 () {60 vars in 1453 bytes} [Fri May 27 09:42:33 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments/23ce0804-3c30-4060-b376-be478f79999c => generated 194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:42:34.144441 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-be23bdc5-a5d0-4d98-8103-3713a2a1c5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:34.144929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-be23bdc5-a5d0-4d98-8103-3713a2a1c5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:34.151274 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-be23bdc5-a5d0-4d98-8103-3713a2a1c5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:34.151738 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-be23bdc5-a5d0-4d98-8103-3713a2a1c5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:34.152559 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-be23bdc5-a5d0-4d98-8103-3713a2a1c5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:34.152993 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-be23bdc5-a5d0-4d98-8103-3713a2a1c5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:34.238028 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-be23bdc5-a5d0-4d98-8103-3713a2a1c5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lazy-loading 'services' on Instance uuid 68f38432-87c8-46fe-b6fe-4795162677ca {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:34.450086 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5ad04001-7909-4653-91fa-618ea358045f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:34.450638 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5ad04001-7909-4653-91fa-618ea358045f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:34.457160 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5ad04001-7909-4653-91fa-618ea358045f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:34.457605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5ad04001-7909-4653-91fa-618ea358045f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:34.458402 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5ad04001-7909-4653-91fa-618ea358045f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:34.458836 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5ad04001-7909-4653-91fa-618ea358045f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:34.591186 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-5ad04001-7909-4653-91fa-618ea358045f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:34.601723 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5ad04001-7909-4653-91fa-618ea358045f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.155446 May 27 09:42:34.602410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 272/550] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:34 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:34.620876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-be23bdc5-a5d0-4d98-8103-3713a2a1c5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "DELETE /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments/23ce0804-3c30-4060-b376-be478f79999c" status: 202 len: 0 microversion: 2.20 time: 0.479790 May 27 09:42:34.625274 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 279/551] 10.222.0.48 () {60 vars in 1456 bytes} [Fri May 27 09:42:34 2022] DELETE /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments/23ce0804-3c30-4060-b376-be478f79999c => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 09:42:34.632725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9a72a101-2ef7-4f36-8c4d-39e79df400a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:34.633789 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9a72a101-2ef7-4f36-8c4d-39e79df400a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:34.640299 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a72a101-2ef7-4f36-8c4d-39e79df400a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:34.641312 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a72a101-2ef7-4f36-8c4d-39e79df400a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:34.642076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a72a101-2ef7-4f36-8c4d-39e79df400a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:34.642548 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a72a101-2ef7-4f36-8c4d-39e79df400a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:34.672945 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9a72a101-2ef7-4f36-8c4d-39e79df400a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 May 27 09:42:34.675470 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 273/552] 10.222.0.48 () {60 vars in 1342 bytes} [Fri May 27 09:42:34 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:42:35.619977 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d57bed4f-4715-4637-a105-84f21aac0a37 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:35.620777 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d57bed4f-4715-4637-a105-84f21aac0a37 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:35.629024 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d57bed4f-4715-4637-a105-84f21aac0a37 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:35.629664 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d57bed4f-4715-4637-a105-84f21aac0a37 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:35.630149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d57bed4f-4715-4637-a105-84f21aac0a37 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:35.630808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d57bed4f-4715-4637-a105-84f21aac0a37 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:35.691838 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-74811e47-af22-46e1-8f34-cedde804d5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:35.693564 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-74811e47-af22-46e1-8f34-cedde804d5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:35.700848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-74811e47-af22-46e1-8f34-cedde804d5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:35.702350 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-74811e47-af22-46e1-8f34-cedde804d5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:35.702350 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-74811e47-af22-46e1-8f34-cedde804d5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:35.702652 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-74811e47-af22-46e1-8f34-cedde804d5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:35.739160 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-74811e47-af22-46e1-8f34-cedde804d5ca tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053704 May 27 09:42:35.739857 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 274/553] 10.222.0.48 () {60 vars in 1342 bytes} [Fri May 27 09:42:35 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 09:42:35.789328 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d57bed4f-4715-4637-a105-84f21aac0a37 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:35.800509 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d57bed4f-4715-4637-a105-84f21aac0a37 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.184507 May 27 09:42:35.801195 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 280/554] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:35 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:36.754086 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3dec1c3c-5471-419c-80c3-6a8d3528ad5f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:36.755650 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3dec1c3c-5471-419c-80c3-6a8d3528ad5f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:36.762173 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3dec1c3c-5471-419c-80c3-6a8d3528ad5f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:36.762649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3dec1c3c-5471-419c-80c3-6a8d3528ad5f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:36.763403 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3dec1c3c-5471-419c-80c3-6a8d3528ad5f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:36.763847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3dec1c3c-5471-419c-80c3-6a8d3528ad5f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:36.791391 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3dec1c3c-5471-419c-80c3-6a8d3528ad5f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041272 May 27 09:42:36.791996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 275/555] 10.222.0.48 () {60 vars in 1342 bytes} [Fri May 27 09:42:36 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:36.819972 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1e542f9f-84f0-4983-948b-50270f97896e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:36.829869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1e542f9f-84f0-4983-948b-50270f97896e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:36.829869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1e542f9f-84f0-4983-948b-50270f97896e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:36.829869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1e542f9f-84f0-4983-948b-50270f97896e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:36.829869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1e542f9f-84f0-4983-948b-50270f97896e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:36.830263 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1e542f9f-84f0-4983-948b-50270f97896e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:36.851784 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-10c7b9e0-14cf-488f-a152-2876a24f4582 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:36.852284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-10c7b9e0-14cf-488f-a152-2876a24f4582 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:36.858879 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-10c7b9e0-14cf-488f-a152-2876a24f4582 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:36.860425 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-10c7b9e0-14cf-488f-a152-2876a24f4582 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:36.861257 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-10c7b9e0-14cf-488f-a152-2876a24f4582 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:36.861701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-10c7b9e0-14cf-488f-a152-2876a24f4582 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:36.891276 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-10c7b9e0-14cf-488f-a152-2876a24f4582 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:42:36.961498 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1e542f9f-84f0-4983-948b-50270f97896e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:36.969548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1e542f9f-84f0-4983-948b-50270f97896e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.153928 May 27 09:42:36.970116 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 281/556] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:36 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:37.257542 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-10c7b9e0-14cf-488f-a152-2876a24f4582 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "DELETE /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 204 len: 0 microversion: 2.20 time: 0.409345 May 27 09:42:37.258125 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 276/557] 10.222.0.48 () {60 vars in 1279 bytes} [Fri May 27 09:42:36 2022] DELETE /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 27 09:42:37.271234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a8579505-975a-48db-a1ea-461b2283ef32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:37.271890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a8579505-975a-48db-a1ea-461b2283ef32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:37.278152 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a8579505-975a-48db-a1ea-461b2283ef32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:37.278632 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a8579505-975a-48db-a1ea-461b2283ef32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:37.279395 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a8579505-975a-48db-a1ea-461b2283ef32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:37.279829 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a8579505-975a-48db-a1ea-461b2283ef32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:37.422250 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a8579505-975a-48db-a1ea-461b2283ef32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:37.430563 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a8579505-975a-48db-a1ea-461b2283ef32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:37.432063 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a8579505-975a-48db-a1ea-461b2283ef32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:37.433214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a8579505-975a-48db-a1ea-461b2283ef32 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.166158 May 27 09:42:37.433837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 282/558] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:37 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:37.987724 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fed22c8f-33eb-4800-b15f-74a07feaf69e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:37.988343 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fed22c8f-33eb-4800-b15f-74a07feaf69e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:37.995184 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fed22c8f-33eb-4800-b15f-74a07feaf69e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:37.995634 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fed22c8f-33eb-4800-b15f-74a07feaf69e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:37.996402 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fed22c8f-33eb-4800-b15f-74a07feaf69e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:37.996836 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fed22c8f-33eb-4800-b15f-74a07feaf69e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:38.136403 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fed22c8f-33eb-4800-b15f-74a07feaf69e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:38.144875 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fed22c8f-33eb-4800-b15f-74a07feaf69e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.161392 May 27 09:42:38.145586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 277/559] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:37 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:38.451002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e71a246b-58f2-45c5-938d-2779709693f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:38.451611 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e71a246b-58f2-45c5-938d-2779709693f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:38.458278 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e71a246b-58f2-45c5-938d-2779709693f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:38.458724 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e71a246b-58f2-45c5-938d-2779709693f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:38.459488 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e71a246b-58f2-45c5-938d-2779709693f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:38.459923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e71a246b-58f2-45c5-938d-2779709693f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:38.589159 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e71a246b-58f2-45c5-938d-2779709693f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:38.597602 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e71a246b-58f2-45c5-938d-2779709693f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:38.599126 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e71a246b-58f2-45c5-938d-2779709693f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:38.600835 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e71a246b-58f2-45c5-938d-2779709693f3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.153283 May 27 09:42:38.600835 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 283/560] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:38 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:42:39.162893 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b459991d-a310-44d7-a757-7a4e57351ecc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:39.163504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b459991d-a310-44d7-a757-7a4e57351ecc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:39.170137 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b459991d-a310-44d7-a757-7a4e57351ecc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:39.170607 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b459991d-a310-44d7-a757-7a4e57351ecc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:39.171376 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b459991d-a310-44d7-a757-7a4e57351ecc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:39.171961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b459991d-a310-44d7-a757-7a4e57351ecc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:39.305493 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b459991d-a310-44d7-a757-7a4e57351ecc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:39.314278 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b459991d-a310-44d7-a757-7a4e57351ecc tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.155155 May 27 09:42:39.314857 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 278/561] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:39 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:39.618398 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9d4bc33a-ccf2-45fa-a032-fa7978d0a966 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:39.619135 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9d4bc33a-ccf2-45fa-a032-fa7978d0a966 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:39.627596 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9d4bc33a-ccf2-45fa-a032-fa7978d0a966 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:39.628626 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9d4bc33a-ccf2-45fa-a032-fa7978d0a966 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:39.628900 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9d4bc33a-ccf2-45fa-a032-fa7978d0a966 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:39.629462 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9d4bc33a-ccf2-45fa-a032-fa7978d0a966 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:40.013976 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9d4bc33a-ccf2-45fa-a032-fa7978d0a966 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:40.022655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9d4bc33a-ccf2-45fa-a032-fa7978d0a966 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:40.024133 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9d4bc33a-ccf2-45fa-a032-fa7978d0a966 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:40.025281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9d4bc33a-ccf2-45fa-a032-fa7978d0a966 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1723 microversion: 2.20 time: 0.410816 May 27 09:42:40.025845 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 284/562] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:39 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:40.332616 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9249085a-1d83-45f9-84f0-8fa084d9d0db tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:40.333581 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9249085a-1d83-45f9-84f0-8fa084d9d0db tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:40.340432 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9249085a-1d83-45f9-84f0-8fa084d9d0db tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:40.341312 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9249085a-1d83-45f9-84f0-8fa084d9d0db tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:40.342020 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9249085a-1d83-45f9-84f0-8fa084d9d0db tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:40.342494 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9249085a-1d83-45f9-84f0-8fa084d9d0db tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:40.362131 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:40.492390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-08d09e93-06b6-4568-a699-e5673b64f04b req-7e058903-4667-4b59-93b5-028fa9d347b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68f38432-87c8-46fe-b6fe-4795162677ca", "name": "network-vif-deleted", "tag": "791d9d86-9101-48e0-92fa-96a2b245c1d6"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:40.503248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-08d09e93-06b6-4568-a699-e5673b64f04b req-7e058903-4667-4b59-93b5-028fa9d347b5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:40.504012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-08d09e93-06b6-4568-a699-e5673b64f04b req-7e058903-4667-4b59-93b5-028fa9d347b5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:40.523875 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9249085a-1d83-45f9-84f0-8fa084d9d0db tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:40.528935 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-08d09e93-06b6-4568-a699-e5673b64f04b req-7e058903-4667-4b59-93b5-028fa9d347b5 service nova] Creating event network-vif-deleted:791d9d86-9101-48e0-92fa-96a2b245c1d6 for instance 68f38432-87c8-46fe-b6fe-4795162677ca on hv-cinder-82549 May 27 09:42:40.537386 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9249085a-1d83-45f9-84f0-8fa084d9d0db tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.209190 May 27 09:42:40.540392 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 279/563] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:40 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:40.555058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-08d09e93-06b6-4568-a699-e5673b64f04b req-7e058903-4667-4b59-93b5-028fa9d347b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139760 May 27 09:42:40.558733 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 285/564] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:41.043964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:41.044582 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:41.051720 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:41.052178 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:41.052955 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:41.053391 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:41.087065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:41.087518 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:41.087971 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lazy-loading 'fault' on Instance uuid 68f38432-87c8-46fe-b6fe-4795162677ca {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:42:41.135603 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:41.144488 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:41.146393 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:41.147789 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3c874b86-7955-4fe8-91c1-bc7b65ae08ea tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 200 len: 1372 microversion: 2.20 time: 0.107883 May 27 09:42:41.148531 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 280/565] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:41 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 1372 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:41.564759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ee5fadd2-804a-4ad1-9ed7-8c28a265f6b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:41.566609 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ee5fadd2-804a-4ad1-9ed7-8c28a265f6b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:41.580245 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ee5fadd2-804a-4ad1-9ed7-8c28a265f6b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:41.581113 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ee5fadd2-804a-4ad1-9ed7-8c28a265f6b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:41.582009 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ee5fadd2-804a-4ad1-9ed7-8c28a265f6b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:41.582571 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ee5fadd2-804a-4ad1-9ed7-8c28a265f6b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:41.733535 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ee5fadd2-804a-4ad1-9ed7-8c28a265f6b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:41.743692 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ee5fadd2-804a-4ad1-9ed7-8c28a265f6b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.186441 May 27 09:42:41.744277 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 286/566] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:41 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:42.169259 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-81b277a0-16ba-4f59-926e-e9f85db17e5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:42.169839 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-81b277a0-16ba-4f59-926e-e9f85db17e5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:42.177444 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-81b277a0-16ba-4f59-926e-e9f85db17e5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:42.177893 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-81b277a0-16ba-4f59-926e-e9f85db17e5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:42.178716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-81b277a0-16ba-4f59-926e-e9f85db17e5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:42.179153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-81b277a0-16ba-4f59-926e-e9f85db17e5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:42.203947 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-81b277a0-16ba-4f59-926e-e9f85db17e5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] HTTP exception thrown: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-81b277a0-16ba-4f59-926e-e9f85db17e5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Request method failure captured: May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca HTTP/1.1 May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuiEUuljjOp6ZFyFHZE2cCiW-lctnUqc4PVDTD-NI_Y30XHmA1PCvSOn9tCVvRbfOBfz9WL7yybcj_I0TksWO-O8UlmqQE4ZQ4JGzOlmTF4uwdxz5_YiAKjcwCCXBNiN9-NT_bULv1dU_4ApgS0uFLx5kM0VrgPafDNv58DBpBDb2Q May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:42:42.205710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_836f9646586d4f409c181cdbfa24cb32", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 8d52fe5018e2450dad79596fb1129c64 May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:42:42.207908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '68f38432-87c8-46fe-b6fe-4795162677ca'} May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:42:42.209097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:42:42.210580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:42:42.211908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-81b277a0-16ba-4f59-926e-e9f85db17e5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Returning 404 to user: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:42:42.211908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-81b277a0-16ba-4f59-926e-e9f85db17e5d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 404 len: 111 microversion: 2.20 time: 0.042096 May 27 09:42:42.211908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 281/567] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:42 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 09:42:42.216292 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f764a445-5337-4bbb-a694-83438b4adbb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '.version_select at 0x7fbe32562700>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:42.339125 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f764a445-5337-4bbb-a694-83438b4adbb4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559445978" status: 204 len: 0 microversion: 2.20 time: 0.126539 May 27 09:42:42.339693 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 287/568] 10.222.0.48 () {60 vars in 1261 bytes} [Fri May 27 09:42:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1559445978 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 09:42:42.761233 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e426f9b6-ace1-4547-b6e9-1b6dde919b8c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:42.761970 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e426f9b6-ace1-4547-b6e9-1b6dde919b8c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:42.778903 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e426f9b6-ace1-4547-b6e9-1b6dde919b8c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:42.778903 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e426f9b6-ace1-4547-b6e9-1b6dde919b8c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:42.778903 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e426f9b6-ace1-4547-b6e9-1b6dde919b8c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:42.778903 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e426f9b6-ace1-4547-b6e9-1b6dde919b8c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:42.955367 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e426f9b6-ace1-4547-b6e9-1b6dde919b8c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:42.965145 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e426f9b6-ace1-4547-b6e9-1b6dde919b8c tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.207930 May 27 09:42:42.976200 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 282/569] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:42 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:43.333963 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a5fdf94e-1bc1-4354-b0d9-588b88194ddf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Action: 'create', calling method: .version_select at 0x7fbe32348940>, body: {"keypair": {"name": "tempest-keypair-1861537304", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGehJl4hLoVPJ9ZgPoOwydAjY7eHTEYgWZ5fQ3kVrAUNmW6EMW4mmvQJZotncV9R7xL0h1HRue+vtIOJEJQCFf/EfUFZ2H+Ie+Kz+tpdv+QhUWj5RASv7UaDGojsKxFRWw=="}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:43.349976 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-a5fdf94e-1bc1-4354-b0d9-588b88194ddf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Getting quotas for project 836f9646586d4f409c181cdbfa24cb32. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:42:43.354031 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-a5fdf94e-1bc1-4354-b0d9-588b88194ddf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Getting quotas for user 8d52fe5018e2450dad79596fb1129c64 and project 836f9646586d4f409c181cdbfa24cb32. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:42:43.453654 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a5fdf94e-1bc1-4354-b0d9-588b88194ddf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.123070 May 27 09:42:43.454351 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 288/570] 10.222.0.48 () {62 vars in 1199 bytes} [Fri May 27 09:42:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 125 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 27 09:42:43.982728 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2d9d829a-83f6-4ed2-b60c-552c6fb6e3bb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:43.983355 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2d9d829a-83f6-4ed2-b60c-552c6fb6e3bb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:43.990319 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2d9d829a-83f6-4ed2-b60c-552c6fb6e3bb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:43.990778 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2d9d829a-83f6-4ed2-b60c-552c6fb6e3bb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:43.991591 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2d9d829a-83f6-4ed2-b60c-552c6fb6e3bb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:43.992035 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2d9d829a-83f6-4ed2-b60c-552c6fb6e3bb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:44.129558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2d9d829a-83f6-4ed2-b60c-552c6fb6e3bb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:44.137752 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2d9d829a-83f6-4ed2-b60c-552c6fb6e3bb tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1737 microversion: 2.1 time: 0.159102 May 27 09:42:44.140753 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 283/571] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:43 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:45.155875 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-85aac87c-ad44-474b-b081-89a0b0dd3e47 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:45.156454 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-85aac87c-ad44-474b-b081-89a0b0dd3e47 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:45.162889 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-85aac87c-ad44-474b-b081-89a0b0dd3e47 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.163349 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-85aac87c-ad44-474b-b081-89a0b0dd3e47 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.164136 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-85aac87c-ad44-474b-b081-89a0b0dd3e47 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.164585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-85aac87c-ad44-474b-b081-89a0b0dd3e47 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.322657 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-85aac87c-ad44-474b-b081-89a0b0dd3e47 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:45.330783 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-85aac87c-ad44-474b-b081-89a0b0dd3e47 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1717 microversion: 2.1 time: 0.179713 May 27 09:42:45.331358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 289/572] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:45 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1717 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:45.450425 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8da2f8e1-73d5-4650-933b-5723dcc7f8d8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:45.450425 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8da2f8e1-73d5-4650-933b-5723dcc7f8d8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:45.451216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:45.456359 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8da2f8e1-73d5-4650-933b-5723dcc7f8d8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.456806 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8da2f8e1-73d5-4650-933b-5723dcc7f8d8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.457639 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8da2f8e1-73d5-4650-933b-5723dcc7f8d8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.458006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8da2f8e1-73d5-4650-933b-5723dcc7f8d8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.590005 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-8da2f8e1-73d5-4650-933b-5723dcc7f8d8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] HTTP exception thrown: Cannot 'detach_volume' instance 28b03ea7-b697-47df-898f-33d7f45ab279 while it is in vm_state rescued May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8da2f8e1-73d5-4650-933b-5723dcc7f8d8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Request method failure captured: May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: DELETE /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments/19ae7cb2-6ed6-4279-94fd-9b0b4a9ce6fd HTTP/1.1 May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJvuSI5jHOqY2C1Tp2SCsB1rovkIRjm2wJf4hz65RNutH_SPrQoDBkvp0GnBa3AUQB1hA-TWNGKN5vDSdhd3DdQEXVS7iqHQ-4OVc0ILrDoxM-uFCx9uwEsold8dkXD1jI6-jlu--3Znf24skIggPZiAjJ6EEkZ7sKpSagXNJ2tfeoI May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 91f6b3c676a84127989cc8e35ce91de1 May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:42:45.591519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91f6b3c676a84127989cc8e35ce91de1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 91f6b3c676a84127989cc8e35ce91de1 May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-ServerRescueNegativeTestJSON-916011391-project May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 5132dcb5580d44e1bc2c7cf4a6893678 May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-ServerRescueNegativeTestJSON-916011391-project May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:42:45.593009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Cannot 'detach_volume' instance 28b03ea7-b697-47df-898f-33d7f45ab279 while it is in vm_state rescued May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'server_id': '28b03ea7-b697-47df-898f-33d7f45ab279', 'id': '19ae7cb2-6ed6-4279-94fd-9b0b4a9ce6fd'} May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 28b03ea7-b697-47df-898f-33d7f45ab279 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:42:45.594300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 28b03ea7-b697-47df-898f-33d7f45ab279 while it is in vm_state rescued May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 28b03ea7-b697-47df-898f-33d7f45ab279 while it is in vm_state rescued May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:42:45.596755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8da2f8e1-73d5-4650-933b-5723dcc7f8d8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Returning 409 to user: Cannot 'detach_volume' instance 28b03ea7-b697-47df-898f-33d7f45ab279 while it is in vm_state rescued {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:42:45.597721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8da2f8e1-73d5-4650-933b-5723dcc7f8d8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "DELETE /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments/19ae7cb2-6ed6-4279-94fd-9b0b4a9ce6fd" status: 409 len: 152 microversion: 2.1 time: 0.153802 May 27 09:42:45.597721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 284/573] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:42:45 2022] DELETE /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments/19ae7cb2-6ed6-4279-94fd-9b0b4a9ce6fd => generated 152 bytes in 156 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 27 09:42:45.603360 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4a7dd223-fa78-4f22-918d-ec9ad1259612 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:45.603899 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4a7dd223-fa78-4f22-918d-ec9ad1259612 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:45.610600 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a7dd223-fa78-4f22-918d-ec9ad1259612 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.611053 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a7dd223-fa78-4f22-918d-ec9ad1259612 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.611853 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a7dd223-fa78-4f22-918d-ec9ad1259612 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.612291 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4a7dd223-fa78-4f22-918d-ec9ad1259612 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.630294 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:45.852795 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4a7dd223-fa78-4f22-918d-ec9ad1259612 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "POST /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/action" status: 202 len: 0 microversion: 2.1 time: 0.252989 May 27 09:42:45.853693 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 290/574] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:42:45 2022] POST /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:42:45.865996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-284f70be-0f3e-4516-9d02-56f5651e59b4 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:45.867314 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-284f70be-0f3e-4516-9d02-56f5651e59b4 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:45.878170 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-284f70be-0f3e-4516-9d02-56f5651e59b4 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.878660 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-284f70be-0f3e-4516-9d02-56f5651e59b4 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:45.879444 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-284f70be-0f3e-4516-9d02-56f5651e59b4 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:45.879886 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-284f70be-0f3e-4516-9d02-56f5651e59b4 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:46.032145 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-284f70be-0f3e-4516-9d02-56f5651e59b4 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:46.040974 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-284f70be-0f3e-4516-9d02-56f5651e59b4 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1725 microversion: 2.1 time: 0.182658 May 27 09:42:46.041674 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 285/575] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:45 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:46.225344 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-189759750", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "96b3e239-6dc9-4aed-81bd-731741d21afd"}], "security_groups": [{"name": "tempest-securitygroup--766583254"}], "key_name": "tempest-keypair-1861537304", "user_data": "}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:46.387655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.network.neutron [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] validate_networks() for [('96b3e239-6dc9-4aed-81bd-731741d21afd', None, None, None, None, None)] {{(pid=124829) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:42:46.951352 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Flavor limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:42:46.951779 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Image limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:42:46.952255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Flavor pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:42:46.953389 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Image pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:42:46.953802 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:42:46.963303 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:46.963666 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:46.964465 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:46.964901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:46.982935 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Getting quotas for project 836f9646586d4f409c181cdbfa24cb32. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:42:46.987263 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Getting quotas for user 8d52fe5018e2450dad79596fb1129c64 and project 836f9646586d4f409c181cdbfa24cb32. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:42:47.001209 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Going to run 1 instances... {{(pid=124829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:42:47.003671 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:42:47.059608 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-36a42958-75bb-4e4a-bff7-d588c920e607 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:47.060474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-36a42958-75bb-4e4a-bff7-d588c920e607 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:47.067949 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-36a42958-75bb-4e4a-bff7-d588c920e607 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:47.068403 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-36a42958-75bb-4e4a-bff7-d588c920e607 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:47.069184 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-36a42958-75bb-4e4a-bff7-d588c920e607 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:47.069632 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-36a42958-75bb-4e4a-bff7-d588c920e607 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:47.143393 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7f9709b9-427a-4ac4-b96d-1289c6033d23 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.923145 May 27 09:42:47.144645 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 291/576] 10.222.0.48 () {62 vars in 1187 bytes} [Fri May 27 09:42:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 27 09:42:47.154355 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4b43dad1-8521-48d6-a42c-1c9d09738c92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:47.156560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4b43dad1-8521-48d6-a42c-1c9d09738c92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:47.206837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-36a42958-75bb-4e4a-bff7-d588c920e607 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:47.215202 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-36a42958-75bb-4e4a-bff7-d588c920e607 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1725 microversion: 2.1 time: 0.159885 May 27 09:42:47.215776 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 286/577] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:47 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:42:47.220953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4b43dad1-8521-48d6-a42c-1c9d09738c92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:47.228859 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4b43dad1-8521-48d6-a42c-1c9d09738c92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:47.230368 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4b43dad1-8521-48d6-a42c-1c9d09738c92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:47.231458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4b43dad1-8521-48d6-a42c-1c9d09738c92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1281 microversion: 2.20 time: 0.081288 May 27 09:42:47.231997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 292/578] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:47 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:42:48.232536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9bb9aec6-240e-4fba-8a0c-6c495d4285b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:48.233171 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9bb9aec6-240e-4fba-8a0c-6c495d4285b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:48.240523 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9bb9aec6-240e-4fba-8a0c-6c495d4285b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:48.240971 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9bb9aec6-240e-4fba-8a0c-6c495d4285b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:48.241741 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9bb9aec6-240e-4fba-8a0c-6c495d4285b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:48.242168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9bb9aec6-240e-4fba-8a0c-6c495d4285b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:48.253306 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e739e78d-b225-48e2-9eb6-c8d3819563d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:48.254235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e739e78d-b225-48e2-9eb6-c8d3819563d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:48.315488 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e739e78d-b225-48e2-9eb6-c8d3819563d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:48.323408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e739e78d-b225-48e2-9eb6-c8d3819563d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:48.324920 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e739e78d-b225-48e2-9eb6-c8d3819563d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:48.326059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e739e78d-b225-48e2-9eb6-c8d3819563d8 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1281 microversion: 2.20 time: 0.079202 May 27 09:42:48.338464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 293/579] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:48 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:42:48.414472 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9bb9aec6-240e-4fba-8a0c-6c495d4285b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:48.423504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9bb9aec6-240e-4fba-8a0c-6c495d4285b9 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1725 microversion: 2.1 time: 0.194647 May 27 09:42:48.424020 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 287/580] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:48 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:49.344242 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-10d3a5fb-c55f-4c70-bd1f-ddec02d25d18 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:49.344903 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-10d3a5fb-c55f-4c70-bd1f-ddec02d25d18 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:49.399984 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-10d3a5fb-c55f-4c70-bd1f-ddec02d25d18 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:49.407533 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-10d3a5fb-c55f-4c70-bd1f-ddec02d25d18 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:49.409218 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-10d3a5fb-c55f-4c70-bd1f-ddec02d25d18 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:49.410398 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-10d3a5fb-c55f-4c70-bd1f-ddec02d25d18 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1281 microversion: 2.20 time: 0.070260 May 27 09:42:49.410974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 294/581] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:49 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:49.441829 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-cd31c49d-5a6c-40ca-acba-bec8082a1828 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:49.443095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-cd31c49d-5a6c-40ca-acba-bec8082a1828 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:49.450709 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cd31c49d-5a6c-40ca-acba-bec8082a1828 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:49.454322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cd31c49d-5a6c-40ca-acba-bec8082a1828 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:49.454322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cd31c49d-5a6c-40ca-acba-bec8082a1828 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:49.454322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cd31c49d-5a6c-40ca-acba-bec8082a1828 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:49.595559 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cd31c49d-5a6c-40ca-acba-bec8082a1828 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:49.603864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-cd31c49d-5a6c-40ca-acba-bec8082a1828 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1725 microversion: 2.1 time: 0.166627 May 27 09:42:49.604436 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 288/582] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:49 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:50.428868 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-430d627b-757b-4d83-802d-92c2cdf8182d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:50.429480 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-430d627b-757b-4d83-802d-92c2cdf8182d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:50.481688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-430d627b-757b-4d83-802d-92c2cdf8182d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:50.489496 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-430d627b-757b-4d83-802d-92c2cdf8182d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:50.491036 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-430d627b-757b-4d83-802d-92c2cdf8182d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:50.492177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-430d627b-757b-4d83-802d-92c2cdf8182d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1281 microversion: 2.20 time: 0.067532 May 27 09:42:50.492732 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 295/583] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:50 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:50.675119 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1162217f-b316-443e-b80d-338a1faf5559 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:50.675724 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1162217f-b316-443e-b80d-338a1faf5559 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:50.682418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1162217f-b316-443e-b80d-338a1faf5559 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:50.682875 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1162217f-b316-443e-b80d-338a1faf5559 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:50.683686 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1162217f-b316-443e-b80d-338a1faf5559 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:50.684742 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1162217f-b316-443e-b80d-338a1faf5559 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:50.815762 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1162217f-b316-443e-b80d-338a1faf5559 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:50.823922 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1162217f-b316-443e-b80d-338a1faf5559 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1731 microversion: 2.1 time: 0.206320 May 27 09:42:50.824419 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 289/584] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:42:50 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1731 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:42:50.840506 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5d981265-7243-4551-978a-0b191b5f76ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:50.840999 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5d981265-7243-4551-978a-0b191b5f76ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:50.848630 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5d981265-7243-4551-978a-0b191b5f76ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:50.849079 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5d981265-7243-4551-978a-0b191b5f76ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:50.849842 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5d981265-7243-4551-978a-0b191b5f76ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:50.850305 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5d981265-7243-4551-978a-0b191b5f76ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:50.933880 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5d981265-7243-4551-978a-0b191b5f76ef tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097278 May 27 09:42:50.934973 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 296/585] 10.222.0.48 () {58 vars in 1274 bytes} [Fri May 27 09:42:50 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:51.510951 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b237f8d0-9711-4693-8590-84e9c2ff54f9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:51.511702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b237f8d0-9711-4693-8590-84e9c2ff54f9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:51.518769 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b237f8d0-9711-4693-8590-84e9c2ff54f9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:51.519209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b237f8d0-9711-4693-8590-84e9c2ff54f9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:51.520128 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b237f8d0-9711-4693-8590-84e9c2ff54f9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:51.520561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b237f8d0-9711-4693-8590-84e9c2ff54f9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:51.594500 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b237f8d0-9711-4693-8590-84e9c2ff54f9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:51.600179 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b237f8d0-9711-4693-8590-84e9c2ff54f9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:51.601730 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b237f8d0-9711-4693-8590-84e9c2ff54f9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:51.602873 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b237f8d0-9711-4693-8590-84e9c2ff54f9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1285 microversion: 2.20 time: 0.095865 May 27 09:42:51.603472 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 290/586] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:51 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:52.234728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-4332d7d0-5f2f-4ae9-b631-f9245c18df45 req-8552be78-00ec-4951-9f10-5fd100b4714d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b03ea7-b697-47df-898f-33d7f45ab279", "tag": "e00cf8d3-9ed6-423d-8c16-e7f1a0445c42"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:52.245089 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-4332d7d0-5f2f-4ae9-b631-f9245c18df45 req-8552be78-00ec-4951-9f10-5fd100b4714d service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:52.245529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-4332d7d0-5f2f-4ae9-b631-f9245c18df45 req-8552be78-00ec-4951-9f10-5fd100b4714d service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:52.258073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-4332d7d0-5f2f-4ae9-b631-f9245c18df45 req-8552be78-00ec-4951-9f10-5fd100b4714d service nova] Creating event network-changed:e00cf8d3-9ed6-423d-8c16-e7f1a0445c42 for instance 28b03ea7-b697-47df-898f-33d7f45ab279 on hv-cinder-82549 May 27 09:42:52.264213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-4332d7d0-5f2f-4ae9-b631-f9245c18df45 req-8552be78-00ec-4951-9f10-5fd100b4714d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035381 May 27 09:42:52.265362 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 297/587] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:52.622076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fe0927b1-b800-4e16-97d2-9077af023d7e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:52.622913 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fe0927b1-b800-4e16-97d2-9077af023d7e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:52.631723 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe0927b1-b800-4e16-97d2-9077af023d7e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:52.632350 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe0927b1-b800-4e16-97d2-9077af023d7e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:52.633170 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe0927b1-b800-4e16-97d2-9077af023d7e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:52.633610 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fe0927b1-b800-4e16-97d2-9077af023d7e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:52.705110 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fe0927b1-b800-4e16-97d2-9077af023d7e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:52.714454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fe0927b1-b800-4e16-97d2-9077af023d7e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:52.716001 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fe0927b1-b800-4e16-97d2-9077af023d7e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:52.717266 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fe0927b1-b800-4e16-97d2-9077af023d7e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1285 microversion: 2.20 time: 0.099688 May 27 09:42:52.719095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 291/588] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:52 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:53.742484 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-911cf04c-9295-47cd-a20b-371c19d47152 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:53.743188 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-911cf04c-9295-47cd-a20b-371c19d47152 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:53.749465 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-911cf04c-9295-47cd-a20b-371c19d47152 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:53.749880 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-911cf04c-9295-47cd-a20b-371c19d47152 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:53.750669 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-911cf04c-9295-47cd-a20b-371c19d47152 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:53.751132 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-911cf04c-9295-47cd-a20b-371c19d47152 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:53.817286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-911cf04c-9295-47cd-a20b-371c19d47152 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:53.828788 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-911cf04c-9295-47cd-a20b-371c19d47152 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:53.830734 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-911cf04c-9295-47cd-a20b-371c19d47152 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:53.832067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-911cf04c-9295-47cd-a20b-371c19d47152 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1333 microversion: 2.20 time: 0.094450 May 27 09:42:53.832762 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 298/589] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:53 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:54.281085 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-6fee7c6b-e74a-4efb-8125-ef3de3930608 req-02ea8ce0-cce0-4adf-94f5-cacd46b1db80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b03ea7-b697-47df-898f-33d7f45ab279", "tag": "e00cf8d3-9ed6-423d-8c16-e7f1a0445c42"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:54.290860 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-6fee7c6b-e74a-4efb-8125-ef3de3930608 req-02ea8ce0-cce0-4adf-94f5-cacd46b1db80 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:54.291432 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-6fee7c6b-e74a-4efb-8125-ef3de3930608 req-02ea8ce0-cce0-4adf-94f5-cacd46b1db80 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:54.304410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-6fee7c6b-e74a-4efb-8125-ef3de3930608 req-02ea8ce0-cce0-4adf-94f5-cacd46b1db80 service nova] Creating event network-changed:e00cf8d3-9ed6-423d-8c16-e7f1a0445c42 for instance 28b03ea7-b697-47df-898f-33d7f45ab279 on hv-cinder-82549 May 27 09:42:54.309977 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-6fee7c6b-e74a-4efb-8125-ef3de3930608 req-02ea8ce0-cce0-4adf-94f5-cacd46b1db80 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032558 May 27 09:42:54.310747 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 292/590] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:42:54.861123 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-74c57790-95e2-412b-b426-7404fd04fb50 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:54.862070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-74c57790-95e2-412b-b426-7404fd04fb50 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:54.865281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:54.872171 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74c57790-95e2-412b-b426-7404fd04fb50 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:54.872888 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74c57790-95e2-412b-b426-7404fd04fb50 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:54.873695 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74c57790-95e2-412b-b426-7404fd04fb50 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:54.874136 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74c57790-95e2-412b-b426-7404fd04fb50 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:54.957148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-74c57790-95e2-412b-b426-7404fd04fb50 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:54.967002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-74c57790-95e2-412b-b426-7404fd04fb50 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:54.968712 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-74c57790-95e2-412b-b426-7404fd04fb50 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:54.969847 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-74c57790-95e2-412b-b426-7404fd04fb50 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1339 microversion: 2.20 time: 0.114930 May 27 09:42:54.970495 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 299/591] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:54 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1339 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:42:55.989311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9dfb0292-82b1-4bdb-8f79-67f7462fa770 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:55.990126 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9dfb0292-82b1-4bdb-8f79-67f7462fa770 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:55.998866 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9dfb0292-82b1-4bdb-8f79-67f7462fa770 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:55.999897 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9dfb0292-82b1-4bdb-8f79-67f7462fa770 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:56.000738 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9dfb0292-82b1-4bdb-8f79-67f7462fa770 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:56.001245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9dfb0292-82b1-4bdb-8f79-67f7462fa770 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:56.157512 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9dfb0292-82b1-4bdb-8f79-67f7462fa770 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:56.165200 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9dfb0292-82b1-4bdb-8f79-67f7462fa770 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:56.166817 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9dfb0292-82b1-4bdb-8f79-67f7462fa770 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:56.168444 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9dfb0292-82b1-4bdb-8f79-67f7462fa770 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1406 microversion: 2.20 time: 0.183859 May 27 09:42:56.169019 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 293/592] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:55 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1406 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:56.405098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-8fc8fade-ea4f-4556-a267-2b842fa4bb17 req-4c10be55-e6cf-471d-819e-c7c6eb5075c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5509199-188d-42fe-9ba4-86939ff60815", "tag": "b4210cbf-916a-49c1-8183-605e8128c6d0"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:42:56.417458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-8fc8fade-ea4f-4556-a267-2b842fa4bb17 req-4c10be55-e6cf-471d-819e-c7c6eb5075c1 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:56.417899 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-8fc8fade-ea4f-4556-a267-2b842fa4bb17 req-4c10be55-e6cf-471d-819e-c7c6eb5075c1 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:56.435526 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-8fc8fade-ea4f-4556-a267-2b842fa4bb17 req-4c10be55-e6cf-471d-819e-c7c6eb5075c1 service nova] Creating event network-changed:b4210cbf-916a-49c1-8183-605e8128c6d0 for instance c5509199-188d-42fe-9ba4-86939ff60815 on hv-cinder-82549 May 27 09:42:56.442619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-8fc8fade-ea4f-4556-a267-2b842fa4bb17 req-4c10be55-e6cf-471d-819e-c7c6eb5075c1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040905 May 27 09:42:56.443534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 300/593] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:42:57.191411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7ddf31a9-a7e5-4166-a101-82959b5ad91d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:57.192190 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7ddf31a9-a7e5-4166-a101-82959b5ad91d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:57.203602 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7ddf31a9-a7e5-4166-a101-82959b5ad91d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:57.204203 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7ddf31a9-a7e5-4166-a101-82959b5ad91d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:57.204985 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7ddf31a9-a7e5-4166-a101-82959b5ad91d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:57.205418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7ddf31a9-a7e5-4166-a101-82959b5ad91d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:57.359181 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7ddf31a9-a7e5-4166-a101-82959b5ad91d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:57.367390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7ddf31a9-a7e5-4166-a101-82959b5ad91d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:57.368880 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7ddf31a9-a7e5-4166-a101-82959b5ad91d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:57.378920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7ddf31a9-a7e5-4166-a101-82959b5ad91d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1406 microversion: 2.20 time: 0.184750 May 27 09:42:57.378920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 294/594] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:57 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1406 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:58.392108 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b75fa15a-b7e6-4d4d-a3fe-c1aaec252f7a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:58.392808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b75fa15a-b7e6-4d4d-a3fe-c1aaec252f7a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:58.394946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:42:58.401357 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b75fa15a-b7e6-4d4d-a3fe-c1aaec252f7a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:58.408051 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b75fa15a-b7e6-4d4d-a3fe-c1aaec252f7a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:58.408051 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b75fa15a-b7e6-4d4d-a3fe-c1aaec252f7a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:58.408051 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b75fa15a-b7e6-4d4d-a3fe-c1aaec252f7a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:58.549998 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b75fa15a-b7e6-4d4d-a3fe-c1aaec252f7a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:58.558822 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b75fa15a-b7e6-4d4d-a3fe-c1aaec252f7a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:58.560586 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b75fa15a-b7e6-4d4d-a3fe-c1aaec252f7a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:58.561924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b75fa15a-b7e6-4d4d-a3fe-c1aaec252f7a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1406 microversion: 2.20 time: 0.175063 May 27 09:42:58.562774 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 301/595] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:58 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:42:59.581506 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-94ef02c8-4d38-4eb3-af05-af7b3afa621c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:42:59.582358 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-94ef02c8-4d38-4eb3-af05-af7b3afa621c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:42:59.589850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-94ef02c8-4d38-4eb3-af05-af7b3afa621c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:59.590338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-94ef02c8-4d38-4eb3-af05-af7b3afa621c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:59.591121 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-94ef02c8-4d38-4eb3-af05-af7b3afa621c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:42:59.591560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-94ef02c8-4d38-4eb3-af05-af7b3afa621c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:42:59.743509 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-94ef02c8-4d38-4eb3-af05-af7b3afa621c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:59.756027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-94ef02c8-4d38-4eb3-af05-af7b3afa621c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:59.757536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-94ef02c8-4d38-4eb3-af05-af7b3afa621c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:42:59.758824 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-94ef02c8-4d38-4eb3-af05-af7b3afa621c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1406 microversion: 2.20 time: 0.181900 May 27 09:42:59.759271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 295/596] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:42:59 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:00.777673 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b0ff405f-e665-417d-b9f5-eb0fed950e28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:00.778409 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b0ff405f-e665-417d-b9f5-eb0fed950e28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:00.781085 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=18 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:00.787529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b0ff405f-e665-417d-b9f5-eb0fed950e28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:00.787988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b0ff405f-e665-417d-b9f5-eb0fed950e28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:00.788795 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b0ff405f-e665-417d-b9f5-eb0fed950e28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:00.789281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b0ff405f-e665-417d-b9f5-eb0fed950e28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:00.953349 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b0ff405f-e665-417d-b9f5-eb0fed950e28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:00.962149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b0ff405f-e665-417d-b9f5-eb0fed950e28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:00.963696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b0ff405f-e665-417d-b9f5-eb0fed950e28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:00.964843 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b0ff405f-e665-417d-b9f5-eb0fed950e28 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1406 microversion: 2.20 time: 0.191678 May 27 09:43:00.965627 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 302/597] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:43:00 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1406 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:01.982475 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-87d60b15-5f30-44c0-8467-93565a3e88b3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:01.983354 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-87d60b15-5f30-44c0-8467-93565a3e88b3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:01.991209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-87d60b15-5f30-44c0-8467-93565a3e88b3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:01.991709 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-87d60b15-5f30-44c0-8467-93565a3e88b3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:01.992560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-87d60b15-5f30-44c0-8467-93565a3e88b3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:01.993117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-87d60b15-5f30-44c0-8467-93565a3e88b3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:02.176244 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-87d60b15-5f30-44c0-8467-93565a3e88b3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:02.185372 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-87d60b15-5f30-44c0-8467-93565a3e88b3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:02.186974 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-87d60b15-5f30-44c0-8467-93565a3e88b3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:02.188119 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-87d60b15-5f30-44c0-8467-93565a3e88b3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1406 microversion: 2.20 time: 0.209755 May 27 09:43:02.188739 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 296/598] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:43:01 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:02.429724 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-cc087577-49d4-443a-b369-9b2f5e4e4cc4 req-5c27081e-2ff5-4e81-80ba-055e2d64fdde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5509199-188d-42fe-9ba4-86939ff60815", "name": "network-vif-plugged", "status": "completed", "tag": "b4210cbf-916a-49c1-8183-605e8128c6d0"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:02.440105 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-cc087577-49d4-443a-b369-9b2f5e4e4cc4 req-5c27081e-2ff5-4e81-80ba-055e2d64fdde service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:02.440707 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-cc087577-49d4-443a-b369-9b2f5e4e4cc4 req-5c27081e-2ff5-4e81-80ba-055e2d64fdde service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:02.454792 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-cc087577-49d4-443a-b369-9b2f5e4e4cc4 req-5c27081e-2ff5-4e81-80ba-055e2d64fdde service nova] Creating event network-vif-plugged:b4210cbf-916a-49c1-8183-605e8128c6d0 for instance c5509199-188d-42fe-9ba4-86939ff60815 on hv-cinder-82549 May 27 09:43:02.460942 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-cc087577-49d4-443a-b369-9b2f5e4e4cc4 req-5c27081e-2ff5-4e81-80ba-055e2d64fdde service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125928 May 27 09:43:02.465700 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 303/599] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:03.210923 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c703d931-b34f-4ec3-af3d-01e39958ca6d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:03.212054 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c703d931-b34f-4ec3-af3d-01e39958ca6d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:03.223514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c703d931-b34f-4ec3-af3d-01e39958ca6d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:03.224271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c703d931-b34f-4ec3-af3d-01e39958ca6d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:03.225818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c703d931-b34f-4ec3-af3d-01e39958ca6d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:03.226680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c703d931-b34f-4ec3-af3d-01e39958ca6d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:03.235780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=100 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:03.398837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c703d931-b34f-4ec3-af3d-01e39958ca6d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:03.409108 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c703d931-b34f-4ec3-af3d-01e39958ca6d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:03.411262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c703d931-b34f-4ec3-af3d-01e39958ca6d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:03.413283 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c703d931-b34f-4ec3-af3d-01e39958ca6d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1406 microversion: 2.20 time: 0.209611 May 27 09:43:03.414289 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 297/600] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:43:03 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:04.435935 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ce91e446-7727-496b-be98-66668894f292 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:04.436752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ce91e446-7727-496b-be98-66668894f292 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:04.443887 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ce91e446-7727-496b-be98-66668894f292 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:04.444498 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ce91e446-7727-496b-be98-66668894f292 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:04.445331 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ce91e446-7727-496b-be98-66668894f292 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:04.445811 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ce91e446-7727-496b-be98-66668894f292 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:04.656585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ce91e446-7727-496b-be98-66668894f292 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:04.665804 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ce91e446-7727-496b-be98-66668894f292 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:04.667456 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ce91e446-7727-496b-be98-66668894f292 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:04.668648 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ce91e446-7727-496b-be98-66668894f292 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1406 microversion: 2.20 time: 0.238248 May 27 09:43:04.669225 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 304/601] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:43:04 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:05.687485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f0701c0b-722d-4cdd-9f0e-9c8aa8d93d90 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:05.688117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f0701c0b-722d-4cdd-9f0e-9c8aa8d93d90 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:05.694865 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f0701c0b-722d-4cdd-9f0e-9c8aa8d93d90 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:05.695312 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f0701c0b-722d-4cdd-9f0e-9c8aa8d93d90 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:05.696082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f0701c0b-722d-4cdd-9f0e-9c8aa8d93d90 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:05.696509 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f0701c0b-722d-4cdd-9f0e-9c8aa8d93d90 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:05.836504 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f0701c0b-722d-4cdd-9f0e-9c8aa8d93d90 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:05.851037 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f0701c0b-722d-4cdd-9f0e-9c8aa8d93d90 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:05.852703 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f0701c0b-722d-4cdd-9f0e-9c8aa8d93d90 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:05.854090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f0701c0b-722d-4cdd-9f0e-9c8aa8d93d90 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1597 microversion: 2.20 time: 0.170452 May 27 09:43:05.854775 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 298/602] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:43:05 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1597 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:43:05.872949 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-309856ae-e25e-49c0-b61c-2a3135c47093 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:05.873633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-309856ae-e25e-49c0-b61c-2a3135c47093 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:05.880408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-309856ae-e25e-49c0-b61c-2a3135c47093 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:05.880859 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-309856ae-e25e-49c0-b61c-2a3135c47093 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:05.881638 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-309856ae-e25e-49c0-b61c-2a3135c47093 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:05.882078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-309856ae-e25e-49c0-b61c-2a3135c47093 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:05.971263 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-309856ae-e25e-49c0-b61c-2a3135c47093 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.102187 May 27 09:43:05.972025 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 305/603] 10.222.0.48 () {60 vars in 1315 bytes} [Fri May 27 09:43:05 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 27 09:43:07.328619 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-65b3f474-3edd-45eb-acb3-4eee7bd7163b req-bfbba9be-6249-4353-9034-d7eecc32b1a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5509199-188d-42fe-9ba4-86939ff60815", "tag": "b4210cbf-916a-49c1-8183-605e8128c6d0"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:07.341062 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-65b3f474-3edd-45eb-acb3-4eee7bd7163b req-bfbba9be-6249-4353-9034-d7eecc32b1a5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:07.343398 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-65b3f474-3edd-45eb-acb3-4eee7bd7163b req-bfbba9be-6249-4353-9034-d7eecc32b1a5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:07.361474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-65b3f474-3edd-45eb-acb3-4eee7bd7163b req-bfbba9be-6249-4353-9034-d7eecc32b1a5 service nova] Creating event network-changed:b4210cbf-916a-49c1-8183-605e8128c6d0 for instance c5509199-188d-42fe-9ba4-86939ff60815 on hv-cinder-82549 May 27 09:43:07.367327 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-65b3f474-3edd-45eb-acb3-4eee7bd7163b req-bfbba9be-6249-4353-9034-d7eecc32b1a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042686 May 27 09:43:07.367941 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 299/604] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:10.097133 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:43:10.097876 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 09:43:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:43:10.997442 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0cf7b14e-f143-4361-a47f-920a87a67223 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:10.999655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0cf7b14e-f143-4361-a47f-920a87a67223 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:11.008871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0cf7b14e-f143-4361-a47f-920a87a67223 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:11.009321 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0cf7b14e-f143-4361-a47f-920a87a67223 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:11.010096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0cf7b14e-f143-4361-a47f-920a87a67223 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:11.010557 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0cf7b14e-f143-4361-a47f-920a87a67223 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:11.041367 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0cf7b14e-f143-4361-a47f-920a87a67223 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051111 May 27 09:43:11.041934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 306/605] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:43:10 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 09:43:11.113090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2c5f1f89-3176-4010-8ff9-310eb1b985a0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:11.113703 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2c5f1f89-3176-4010-8ff9-310eb1b985a0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:11.120681 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c5f1f89-3176-4010-8ff9-310eb1b985a0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:11.121126 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c5f1f89-3176-4010-8ff9-310eb1b985a0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:11.122165 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c5f1f89-3176-4010-8ff9-310eb1b985a0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:11.122669 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c5f1f89-3176-4010-8ff9-310eb1b985a0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:11.150530 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2c5f1f89-3176-4010-8ff9-310eb1b985a0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:43:11.702858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2c5f1f89-3176-4010-8ff9-310eb1b985a0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 204 len: 0 microversion: 2.1 time: 0.597542 May 27 09:43:11.703426 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 300/606] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:43:11 2022] DELETE /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:43:11.711998 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-23683e92-8b68-42b6-972b-7e9ecf0f8084 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:11.712617 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-23683e92-8b68-42b6-972b-7e9ecf0f8084 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:11.719740 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23683e92-8b68-42b6-972b-7e9ecf0f8084 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:11.720176 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23683e92-8b68-42b6-972b-7e9ecf0f8084 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:11.720943 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23683e92-8b68-42b6-972b-7e9ecf0f8084 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:11.721369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23683e92-8b68-42b6-972b-7e9ecf0f8084 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:11.859279 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-23683e92-8b68-42b6-972b-7e9ecf0f8084 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:11.866430 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-23683e92-8b68-42b6-972b-7e9ecf0f8084 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1672 microversion: 2.1 time: 0.158218 May 27 09:43:11.867040 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 307/607] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:11 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:12.892931 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9fcc868c-e5d2-4094-add2-53c4786b8702 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:12.893621 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9fcc868c-e5d2-4094-add2-53c4786b8702 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:12.900428 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9fcc868c-e5d2-4094-add2-53c4786b8702 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:12.906916 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9fcc868c-e5d2-4094-add2-53c4786b8702 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:12.906916 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9fcc868c-e5d2-4094-add2-53c4786b8702 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:12.906916 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9fcc868c-e5d2-4094-add2-53c4786b8702 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:13.045924 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9fcc868c-e5d2-4094-add2-53c4786b8702 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:13.054814 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9fcc868c-e5d2-4094-add2-53c4786b8702 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1672 microversion: 2.1 time: 0.166871 May 27 09:43:13.055416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 301/608] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:12 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:14.074523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-da1377cd-c373-4460-a94a-a3a5b3b59f25 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:14.075528 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-da1377cd-c373-4460-a94a-a3a5b3b59f25 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:14.083781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da1377cd-c373-4460-a94a-a3a5b3b59f25 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:14.084143 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da1377cd-c373-4460-a94a-a3a5b3b59f25 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:14.084934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da1377cd-c373-4460-a94a-a3a5b3b59f25 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:14.085464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-da1377cd-c373-4460-a94a-a3a5b3b59f25 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:14.184802 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-da1377cd-c373-4460-a94a-a3a5b3b59f25 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:14.198561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-4df18555-75ce-4782-9446-600624fdb07a req-8709b41b-ca1c-4ec5-9983-1fd689aa5713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b5ab4e3-6570-4604-b7fb-7592f7bb0d41", "name": "network-vif-deleted", "tag": "374cd9b1-daa3-43bc-a1a9-b6bb36c1e8d5"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:14.208523 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-4df18555-75ce-4782-9446-600624fdb07a req-8709b41b-ca1c-4ec5-9983-1fd689aa5713 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:14.209068 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-4df18555-75ce-4782-9446-600624fdb07a req-8709b41b-ca1c-4ec5-9983-1fd689aa5713 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:14.213014 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-da1377cd-c373-4460-a94a-a3a5b3b59f25 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1605 microversion: 2.1 time: 0.143320 May 27 09:43:14.224904 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 308/609] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:14 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1605 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:14.228842 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-4df18555-75ce-4782-9446-600624fdb07a req-8709b41b-ca1c-4ec5-9983-1fd689aa5713 service nova] Creating event network-vif-deleted:374cd9b1-daa3-43bc-a1a9-b6bb36c1e8d5 for instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 on hv-cinder-82549 May 27 09:43:14.235728 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-4df18555-75ce-4782-9446-600624fdb07a req-8709b41b-ca1c-4ec5-9983-1fd689aa5713 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041206 May 27 09:43:14.236975 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 302/610] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:14.903079 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:43:14.903418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 09:43:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:43:15.232734 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:15.234222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:15.241451 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:15.241895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:15.243423 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:15.243423 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:15.287555 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:15.287995 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:15.288449 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lazy-loading 'fault' on Instance uuid 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:43:15.350717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:15.362454 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0e8c145d-570b-49f6-a7f4-664d7c93ef89 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 200 len: 1327 microversion: 2.1 time: 0.133440 May 27 09:43:15.363698 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 309/611] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:15 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 1327 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:43:16.389859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5222ae34-a33f-433f-9a11-2761aa526359 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:16.390589 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5222ae34-a33f-433f-9a11-2761aa526359 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:16.398578 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5222ae34-a33f-433f-9a11-2761aa526359 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:16.399028 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5222ae34-a33f-433f-9a11-2761aa526359 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:16.399807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5222ae34-a33f-433f-9a11-2761aa526359 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:16.400243 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5222ae34-a33f-433f-9a11-2761aa526359 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:16.415650 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-5222ae34-a33f-433f-9a11-2761aa526359 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] HTTP exception thrown: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5222ae34-a33f-433f-9a11-2761aa526359 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Request method failure captured: May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 HTTP/1.1 May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuia6YFrK2Odk74OfWALKtT0Zt08Eb8K4pP0ol5D71Y17mP1TTqNM-WNzrgE8uV7PXGPerOAFkbmv53uV2nrh3hJ1w7-D7XuPhNcghNueFiXCk699Yh3fZl6bJOVqsfFMvNVhFucf6LYU5ptXfLxAnmk4IBPjrX0it1gtm8FSMHXBY May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:43:16.417316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_64c171ba5fcb489d911aeb8c5abf4bb2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-AttachVolumeTestJSON-1295942379 May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: e5081aed86004f6c99a05c9fbf2a36b9 May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:43:16.418950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '8b5ab4e3-6570-4604-b7fb-7592f7bb0d41'} May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:43:16.420016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:43:16.422065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:43:16.423220 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5222ae34-a33f-433f-9a11-2761aa526359 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Returning 404 to user: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:43:16.423220 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5222ae34-a33f-433f-9a11-2761aa526359 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 404 len: 111 microversion: 2.1 time: 0.033587 May 27 09:43:16.423220 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 303/612] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:16 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:43:16.428936 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3293766a-c0c2-4954-812c-ccb3cfbfaf93 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '.version_select at 0x7fbe323f3b80>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:16.515469 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3293766a-c0c2-4954-812c-ccb3cfbfaf93 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-756230224" status: 202 len: 0 microversion: 2.1 time: 0.090203 May 27 09:43:16.516059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 310/613] 10.222.0.48 () {58 vars in 1217 bytes} [Fri May 27 09:43:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-756230224 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:43:17.395902 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-04a591a9-508a-4f1a-b3fd-b331cf3d96b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'create', calling method: .version_select at 0x7fbe323e5a60>, body: {"keypair": {"name": "tempest-keypair-240591320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjvDa1tf2wGm87jsuudIj8wm7MrGb+PtXSv8BefQQ82wEHGLbSKfuReraKWi9KeyJbq0amoVs8u16GEJU1muGVn6K3T17f2IWY5CnnHm18nxszEgQh1gKVLFvIlH9IGSw=="}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:17.400434 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:17.411920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-04a591a9-508a-4f1a-b3fd-b331cf3d96b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Getting quotas for project 64c171ba5fcb489d911aeb8c5abf4bb2. Resources: {'key_pairs'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:43:17.415853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-04a591a9-508a-4f1a-b3fd-b331cf3d96b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Getting quotas for user e5081aed86004f6c99a05c9fbf2a36b9 and project 64c171ba5fcb489d911aeb8c5abf4bb2. Resources: {'key_pairs'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:43:17.538728 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-04a591a9-508a-4f1a-b3fd-b331cf3d96b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.146599 May 27 09:43:17.539299 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 304/614] 10.222.0.48 () {60 vars in 1158 bytes} [Fri May 27 09:43:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:20.423625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1072287256", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ed46cb4-c2ad-455c-9533-303118efbcc7"}], "security_groups": [{"name": "tempest-securitygroup--171861659"}], "key_name": "tempest-keypair-240591320", "user_data": "}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:20.525710 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.network.neutron [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] validate_networks() for [('9ed46cb4-c2ad-455c-9533-303118efbcc7', None, None, None, None, None)] {{(pid=124829) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:43:20.918458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Flavor limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:43:20.918905 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Image limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:43:20.919379 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Flavor pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:43:20.919799 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Image pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:43:20.920200 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:43:20.930437 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:20.930973 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:20.931907 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:20.932467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:20.940560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:20.952326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Getting quotas for project 64c171ba5fcb489d911aeb8c5abf4bb2. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:43:20.956610 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Getting quotas for user e5081aed86004f6c99a05c9fbf2a36b9 and project 64c171ba5fcb489d911aeb8c5abf4bb2. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:43:20.969509 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Going to run 1 instances... {{(pid=124829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:43:20.971851 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:43:21.131853 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ac004835-051a-484e-b002-e314d94dae38 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.713785 May 27 09:43:21.132467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 311/615] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:43:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:43:21.142876 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7b5573fa-1f52-467d-acd1-1f54bd61ae14 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:21.143503 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7b5573fa-1f52-467d-acd1-1f54bd61ae14 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:21.203906 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7b5573fa-1f52-467d-acd1-1f54bd61ae14 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:21.211209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7b5573fa-1f52-467d-acd1-1f54bd61ae14 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1237 microversion: 2.1 time: 0.072367 May 27 09:43:21.211786 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 305/616] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:21 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:22.228160 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8b8e53ed-d225-4945-9af6-d3170b27b875 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:22.228789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8b8e53ed-d225-4945-9af6-d3170b27b875 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:22.238827 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8b8e53ed-d225-4945-9af6-d3170b27b875 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:22.239272 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8b8e53ed-d225-4945-9af6-d3170b27b875 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:22.240032 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8b8e53ed-d225-4945-9af6-d3170b27b875 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:22.240491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8b8e53ed-d225-4945-9af6-d3170b27b875 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:22.318778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8b8e53ed-d225-4945-9af6-d3170b27b875 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:22.321955 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8b8e53ed-d225-4945-9af6-d3170b27b875 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1241 microversion: 2.1 time: 0.098152 May 27 09:43:22.322682 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 312/617] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:22 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:23.341105 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5eb08c8f-a825-4752-92f1-649bf66b1fea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:23.341952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5eb08c8f-a825-4752-92f1-649bf66b1fea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:23.349543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5eb08c8f-a825-4752-92f1-649bf66b1fea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:23.350005 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5eb08c8f-a825-4752-92f1-649bf66b1fea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:23.350858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5eb08c8f-a825-4752-92f1-649bf66b1fea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:23.351300 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5eb08c8f-a825-4752-92f1-649bf66b1fea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:23.443707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-5eb08c8f-a825-4752-92f1-649bf66b1fea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:23.457626 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5eb08c8f-a825-4752-92f1-649bf66b1fea tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1297 microversion: 2.1 time: 0.120045 May 27 09:43:23.458742 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 306/618] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:23 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1297 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:24.481686 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-91314e12-da8b-4673-8103-ef065dfb7462 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:24.482579 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-91314e12-da8b-4673-8103-ef065dfb7462 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:24.491043 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-91314e12-da8b-4673-8103-ef065dfb7462 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:24.491499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-91314e12-da8b-4673-8103-ef065dfb7462 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:24.492534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-91314e12-da8b-4673-8103-ef065dfb7462 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:24.492973 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-91314e12-da8b-4673-8103-ef065dfb7462 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:24.839953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-91314e12-da8b-4673-8103-ef065dfb7462 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:24.848508 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-91314e12-da8b-4673-8103-ef065dfb7462 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.371852 May 27 09:43:24.849077 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 313/619] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:24 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:25.866877 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c1c09f56-b33a-40ba-afa3-561ffae42a28 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:25.867494 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c1c09f56-b33a-40ba-afa3-561ffae42a28 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:25.875281 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c1c09f56-b33a-40ba-afa3-561ffae42a28 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:25.875636 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c1c09f56-b33a-40ba-afa3-561ffae42a28 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:25.876424 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c1c09f56-b33a-40ba-afa3-561ffae42a28 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:25.876962 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c1c09f56-b33a-40ba-afa3-561ffae42a28 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:25.939130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-5e676b18-7737-4b44-b035-7a06b2ed2595 req-ccbdf4be-a93f-4a33-a90a-c05dc797946f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858596a7-d1e4-4c2f-a1fd-f5c46f9dd974", "tag": "e0f16fa2-bfdd-4cee-ba09-8f3e12eb87f2"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:25.948511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-5e676b18-7737-4b44-b035-7a06b2ed2595 req-ccbdf4be-a93f-4a33-a90a-c05dc797946f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:25.949324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-5e676b18-7737-4b44-b035-7a06b2ed2595 req-ccbdf4be-a93f-4a33-a90a-c05dc797946f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:25.973877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-5e676b18-7737-4b44-b035-7a06b2ed2595 req-ccbdf4be-a93f-4a33-a90a-c05dc797946f service nova] Creating event network-changed:e0f16fa2-bfdd-4cee-ba09-8f3e12eb87f2 for instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 on hv-cinder-82549 May 27 09:43:25.986586 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-5e676b18-7737-4b44-b035-7a06b2ed2595 req-ccbdf4be-a93f-4a33-a90a-c05dc797946f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051267 May 27 09:43:25.987712 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 314/620] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:43:26.077773 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c1c09f56-b33a-40ba-afa3-561ffae42a28 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:26.082133 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c1c09f56-b33a-40ba-afa3-561ffae42a28 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.219012 May 27 09:43:26.083056 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 307/621] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:25 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:27.104383 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-cab4cfbf-2695-4eb8-801e-aaecd0cb4f31 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:27.105479 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-cab4cfbf-2695-4eb8-801e-aaecd0cb4f31 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:27.113367 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cab4cfbf-2695-4eb8-801e-aaecd0cb4f31 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:27.113878 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cab4cfbf-2695-4eb8-801e-aaecd0cb4f31 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:27.114706 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cab4cfbf-2695-4eb8-801e-aaecd0cb4f31 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:27.115154 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cab4cfbf-2695-4eb8-801e-aaecd0cb4f31 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:27.276093 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cab4cfbf-2695-4eb8-801e-aaecd0cb4f31 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:27.289186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-cab4cfbf-2695-4eb8-801e-aaecd0cb4f31 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.189039 May 27 09:43:27.290236 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 315/622] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:27 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:28.309343 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3d961a2e-3663-4b9e-8751-ab92ea336ccc tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:28.309976 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3d961a2e-3663-4b9e-8751-ab92ea336ccc tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:28.321076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3d961a2e-3663-4b9e-8751-ab92ea336ccc tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:28.321724 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3d961a2e-3663-4b9e-8751-ab92ea336ccc tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:28.322791 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3d961a2e-3663-4b9e-8751-ab92ea336ccc tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:28.323578 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3d961a2e-3663-4b9e-8751-ab92ea336ccc tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:28.478358 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3d961a2e-3663-4b9e-8751-ab92ea336ccc tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:28.490485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3d961a2e-3663-4b9e-8751-ab92ea336ccc tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.184905 May 27 09:43:28.491087 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 308/623] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:28 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:29.507582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a1526f0b-00ed-44f8-a0be-c2b2cc2515be tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:29.508196 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a1526f0b-00ed-44f8-a0be-c2b2cc2515be tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:29.510742 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:29.515766 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a1526f0b-00ed-44f8-a0be-c2b2cc2515be tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:29.516247 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a1526f0b-00ed-44f8-a0be-c2b2cc2515be tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:29.517037 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a1526f0b-00ed-44f8-a0be-c2b2cc2515be tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:29.517471 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a1526f0b-00ed-44f8-a0be-c2b2cc2515be tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:29.665502 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a1526f0b-00ed-44f8-a0be-c2b2cc2515be tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:29.674402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a1526f0b-00ed-44f8-a0be-c2b2cc2515be tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.170362 May 27 09:43:29.675002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 316/624] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:29 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:30.692187 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-00ebff63-3783-4b9a-abad-da3c81df0dce tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:30.692802 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-00ebff63-3783-4b9a-abad-da3c81df0dce tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:30.699448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-00ebff63-3783-4b9a-abad-da3c81df0dce tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:30.699897 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-00ebff63-3783-4b9a-abad-da3c81df0dce tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:30.700669 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-00ebff63-3783-4b9a-abad-da3c81df0dce tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:30.701101 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-00ebff63-3783-4b9a-abad-da3c81df0dce tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:30.842670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-00ebff63-3783-4b9a-abad-da3c81df0dce tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:30.850590 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-00ebff63-3783-4b9a-abad-da3c81df0dce tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.162233 May 27 09:43:30.851206 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 309/625] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:30 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:31.869152 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8ef8fd49-90ae-492b-b9f6-6b889c5727f7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:31.869855 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8ef8fd49-90ae-492b-b9f6-6b889c5727f7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:31.872454 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:31.873218 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=6 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:31.879363 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8ef8fd49-90ae-492b-b9f6-6b889c5727f7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:31.879703 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8ef8fd49-90ae-492b-b9f6-6b889c5727f7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:31.880713 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8ef8fd49-90ae-492b-b9f6-6b889c5727f7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:31.881220 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8ef8fd49-90ae-492b-b9f6-6b889c5727f7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:32.015165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8ef8fd49-90ae-492b-b9f6-6b889c5727f7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:32.023182 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8ef8fd49-90ae-492b-b9f6-6b889c5727f7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.157952 May 27 09:43:32.023766 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 317/626] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:31 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:33.041772 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-66dd6d69-8220-4cb0-bfa1-b081c55b9529 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:33.042408 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-66dd6d69-8220-4cb0-bfa1-b081c55b9529 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:33.044452 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=6 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:33.051210 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-66dd6d69-8220-4cb0-bfa1-b081c55b9529 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:33.051655 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-66dd6d69-8220-4cb0-bfa1-b081c55b9529 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:33.052428 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-66dd6d69-8220-4cb0-bfa1-b081c55b9529 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:33.052864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-66dd6d69-8220-4cb0-bfa1-b081c55b9529 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:33.193561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-66dd6d69-8220-4cb0-bfa1-b081c55b9529 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:33.201286 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-66dd6d69-8220-4cb0-bfa1-b081c55b9529 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.164369 May 27 09:43:33.201896 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 310/627] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:33 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:43:34.219762 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b8f694a4-938b-4931-9010-6e49859f4779 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:34.220435 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b8f694a4-938b-4931-9010-6e49859f4779 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:34.227806 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b8f694a4-938b-4931-9010-6e49859f4779 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:34.228258 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b8f694a4-938b-4931-9010-6e49859f4779 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:34.229024 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b8f694a4-938b-4931-9010-6e49859f4779 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:34.229976 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b8f694a4-938b-4931-9010-6e49859f4779 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:34.375388 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b8f694a4-938b-4931-9010-6e49859f4779 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:34.383703 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b8f694a4-938b-4931-9010-6e49859f4779 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.168048 May 27 09:43:34.393219 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 318/628] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:34 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:43:34.572112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-337895c0-4fe2-423b-b18f-a00e8e4d07e0 req-ce52acf3-616b-4ea4-adc6-4573e588c027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858596a7-d1e4-4c2f-a1fd-f5c46f9dd974", "name": "network-vif-plugged", "status": "completed", "tag": "e0f16fa2-bfdd-4cee-ba09-8f3e12eb87f2"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:34.580839 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-337895c0-4fe2-423b-b18f-a00e8e4d07e0 req-ce52acf3-616b-4ea4-adc6-4573e588c027 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:34.581289 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-337895c0-4fe2-423b-b18f-a00e8e4d07e0 req-ce52acf3-616b-4ea4-adc6-4573e588c027 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:34.584993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:34.593766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-337895c0-4fe2-423b-b18f-a00e8e4d07e0 req-ce52acf3-616b-4ea4-adc6-4573e588c027 service nova] Creating event network-vif-plugged:e0f16fa2-bfdd-4cee-ba09-8f3e12eb87f2 for instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 on hv-cinder-82549 May 27 09:43:34.598767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-337895c0-4fe2-423b-b18f-a00e8e4d07e0 req-ce52acf3-616b-4ea4-adc6-4573e588c027 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031180 May 27 09:43:34.599347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 311/629] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:35.402947 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2c0ca53e-c3c5-47d8-9e07-e9650893d7d9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:35.403637 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2c0ca53e-c3c5-47d8-9e07-e9650893d7d9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:35.410973 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c0ca53e-c3c5-47d8-9e07-e9650893d7d9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:35.413548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c0ca53e-c3c5-47d8-9e07-e9650893d7d9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:35.413548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c0ca53e-c3c5-47d8-9e07-e9650893d7d9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:35.413548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c0ca53e-c3c5-47d8-9e07-e9650893d7d9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:35.558364 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2c0ca53e-c3c5-47d8-9e07-e9650893d7d9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:35.567049 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2c0ca53e-c3c5-47d8-9e07-e9650893d7d9 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.167985 May 27 09:43:35.570872 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 319/630] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:35 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:36.585716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c7b0aa01-9fa2-4ab4-bf8f-afbfc702208b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:36.586458 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c7b0aa01-9fa2-4ab4-bf8f-afbfc702208b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:36.593871 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c7b0aa01-9fa2-4ab4-bf8f-afbfc702208b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:36.594345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c7b0aa01-9fa2-4ab4-bf8f-afbfc702208b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:36.595115 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c7b0aa01-9fa2-4ab4-bf8f-afbfc702208b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:36.595547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c7b0aa01-9fa2-4ab4-bf8f-afbfc702208b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:36.739024 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c7b0aa01-9fa2-4ab4-bf8f-afbfc702208b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:36.747312 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c7b0aa01-9fa2-4ab4-bf8f-afbfc702208b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1362 microversion: 2.1 time: 0.166682 May 27 09:43:36.750725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 312/631] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:36 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1362 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:37.765235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-19f5e006-edbb-4ca9-ba1c-7dccd5b0c578 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:37.765974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-19f5e006-edbb-4ca9-ba1c-7dccd5b0c578 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:37.772762 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19f5e006-edbb-4ca9-ba1c-7dccd5b0c578 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:37.773200 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19f5e006-edbb-4ca9-ba1c-7dccd5b0c578 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:37.773953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19f5e006-edbb-4ca9-ba1c-7dccd5b0c578 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:37.774407 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-19f5e006-edbb-4ca9-ba1c-7dccd5b0c578 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:37.907736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-19f5e006-edbb-4ca9-ba1c-7dccd5b0c578 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:37.915604 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-19f5e006-edbb-4ca9-ba1c-7dccd5b0c578 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1547 microversion: 2.1 time: 0.154143 May 27 09:43:37.918661 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 320/632] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:37 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:37.933484 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-45c0713b-166b-4e50-a0d3-d64f1ef91c86 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:37.934054 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-45c0713b-166b-4e50-a0d3-d64f1ef91c86 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:37.940837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-45c0713b-166b-4e50-a0d3-d64f1ef91c86 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:37.941278 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-45c0713b-166b-4e50-a0d3-d64f1ef91c86 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:37.942052 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-45c0713b-166b-4e50-a0d3-d64f1ef91c86 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:37.942546 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-45c0713b-166b-4e50-a0d3-d64f1ef91c86 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:38.031817 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-45c0713b-166b-4e50-a0d3-d64f1ef91c86 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102225 May 27 09:43:38.032425 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 313/633] 10.222.0.48 () {58 vars in 1274 bytes} [Fri May 27 09:43:37 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:39.195482 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-3c428944-7ea1-4536-a79d-dfa092ab0492 req-1ba17c57-a159-4bd8-aba6-54dd0460e289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858596a7-d1e4-4c2f-a1fd-f5c46f9dd974", "tag": "e0f16fa2-bfdd-4cee-ba09-8f3e12eb87f2"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:43:39.204158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-3c428944-7ea1-4536-a79d-dfa092ab0492 req-1ba17c57-a159-4bd8-aba6-54dd0460e289 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:39.204599 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-3c428944-7ea1-4536-a79d-dfa092ab0492 req-1ba17c57-a159-4bd8-aba6-54dd0460e289 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:39.216527 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-3c428944-7ea1-4536-a79d-dfa092ab0492 req-1ba17c57-a159-4bd8-aba6-54dd0460e289 service nova] Creating event network-changed:e0f16fa2-bfdd-4cee-ba09-8f3e12eb87f2 for instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 on hv-cinder-82549 May 27 09:43:39.222146 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-3c428944-7ea1-4536-a79d-dfa092ab0492 req-1ba17c57-a159-4bd8-aba6-54dd0460e289 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034268 May 27 09:43:39.222915 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 321/634] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:55.783658 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:55.784560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=11 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:55.789201 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e42733cd-897f-4c53-99b1-2c44f813b10e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:55.789733 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e42733cd-897f-4c53-99b1-2c44f813b10e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:55.796455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e42733cd-897f-4c53-99b1-2c44f813b10e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:55.796903 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e42733cd-897f-4c53-99b1-2c44f813b10e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:55.797677 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e42733cd-897f-4c53-99b1-2c44f813b10e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:55.798112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e42733cd-897f-4c53-99b1-2c44f813b10e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:55.881536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-e42733cd-897f-4c53-99b1-2c44f813b10e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lazy-loading 'services' on Instance uuid 28b03ea7-b697-47df-898f-33d7f45ab279 {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:43:56.180824 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e42733cd-897f-4c53-99b1-2c44f813b10e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "DELETE /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments/19ae7cb2-6ed6-4279-94fd-9b0b4a9ce6fd" status: 202 len: 0 microversion: 2.1 time: 0.398736 May 27 09:43:56.181433 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 314/635] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:43:55 2022] DELETE /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments/19ae7cb2-6ed6-4279-94fd-9b0b4a9ce6fd => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:43:56.188706 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=11 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:56.189679 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=53 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:43:56.194053 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8f8f5b93-d83b-4b42-b79b-dc4e15ff0569 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:56.195148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8f8f5b93-d83b-4b42-b79b-dc4e15ff0569 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:56.201484 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8f8f5b93-d83b-4b42-b79b-dc4e15ff0569 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:56.201931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8f8f5b93-d83b-4b42-b79b-dc4e15ff0569 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:56.203062 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8f8f5b93-d83b-4b42-b79b-dc4e15ff0569 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:56.203509 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8f8f5b93-d83b-4b42-b79b-dc4e15ff0569 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:56.233011 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8f8f5b93-d83b-4b42-b79b-dc4e15ff0569 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 May 27 09:43:56.233635 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 322/636] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:43:56 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:57.246376 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b0d58307-b26f-4ae5-b4d7-ed01a5dabb70 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:57.247245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b0d58307-b26f-4ae5-b4d7-ed01a5dabb70 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:57.254774 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b0d58307-b26f-4ae5-b4d7-ed01a5dabb70 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:57.255228 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b0d58307-b26f-4ae5-b4d7-ed01a5dabb70 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:57.256006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b0d58307-b26f-4ae5-b4d7-ed01a5dabb70 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:57.256443 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b0d58307-b26f-4ae5-b4d7-ed01a5dabb70 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:57.289761 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b0d58307-b26f-4ae5-b4d7-ed01a5dabb70 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048285 May 27 09:43:57.293876 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 315/637] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:43:57 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:43:58.301660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-238a587c-db2a-4e4b-a016-31fcdc6dd2b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:58.302609 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-238a587c-db2a-4e4b-a016-31fcdc6dd2b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:58.309949 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-238a587c-db2a-4e4b-a016-31fcdc6dd2b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:58.310428 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-238a587c-db2a-4e4b-a016-31fcdc6dd2b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:58.311688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-238a587c-db2a-4e4b-a016-31fcdc6dd2b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:58.312124 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-238a587c-db2a-4e4b-a016-31fcdc6dd2b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:58.341264 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-238a587c-db2a-4e4b-a016-31fcdc6dd2b8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043744 May 27 09:43:58.347782 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 323/638] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:43:58 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:43:58.418032 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c96d136f-1212-4c8c-9045-f94f5814186a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:58.418620 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c96d136f-1212-4c8c-9045-f94f5814186a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:58.425919 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c96d136f-1212-4c8c-9045-f94f5814186a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:58.426401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c96d136f-1212-4c8c-9045-f94f5814186a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:58.427159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c96d136f-1212-4c8c-9045-f94f5814186a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:58.427585 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c96d136f-1212-4c8c-9045-f94f5814186a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:58.452517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c96d136f-1212-4c8c-9045-f94f5814186a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:43:58.799408 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c96d136f-1212-4c8c-9045-f94f5814186a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "DELETE /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 204 len: 0 microversion: 2.1 time: 0.385010 May 27 09:43:58.800002 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 316/639] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:43:58 2022] DELETE /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:43:58.808159 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-237075ac-06ed-42b9-aa7c-940c2d11fe53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:58.808890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-237075ac-06ed-42b9-aa7c-940c2d11fe53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:58.815128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-237075ac-06ed-42b9-aa7c-940c2d11fe53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:58.815582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-237075ac-06ed-42b9-aa7c-940c2d11fe53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:58.816436 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-237075ac-06ed-42b9-aa7c-940c2d11fe53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:58.816899 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-237075ac-06ed-42b9-aa7c-940c2d11fe53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:58.950511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-237075ac-06ed-42b9-aa7c-940c2d11fe53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:43:58.958016 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-237075ac-06ed-42b9-aa7c-940c2d11fe53 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1691 microversion: 2.1 time: 0.153730 May 27 09:43:58.958608 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 324/640] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:58 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:43:59.976731 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bdd23441-5517-4c72-965e-70b30b4cfa88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:43:59.977361 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bdd23441-5517-4c72-965e-70b30b4cfa88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:43:59.984487 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bdd23441-5517-4c72-965e-70b30b4cfa88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:59.984979 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bdd23441-5517-4c72-965e-70b30b4cfa88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:43:59.985739 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bdd23441-5517-4c72-965e-70b30b4cfa88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:43:59.986162 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bdd23441-5517-4c72-965e-70b30b4cfa88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:00.117834 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bdd23441-5517-4c72-965e-70b30b4cfa88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:00.125563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bdd23441-5517-4c72-965e-70b30b4cfa88 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1691 microversion: 2.1 time: 0.153091 May 27 09:44:00.126142 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 317/641] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:43:59 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:01.142834 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c7d3e731-413c-4440-8122-bd81ae984e77 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:01.143559 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c7d3e731-413c-4440-8122-bd81ae984e77 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:01.150214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7d3e731-413c-4440-8122-bd81ae984e77 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:01.150660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7d3e731-413c-4440-8122-bd81ae984e77 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:01.151415 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7d3e731-413c-4440-8122-bd81ae984e77 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:01.151851 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7d3e731-413c-4440-8122-bd81ae984e77 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:01.286856 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c7d3e731-413c-4440-8122-bd81ae984e77 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:01.294340 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c7d3e731-413c-4440-8122-bd81ae984e77 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1691 microversion: 2.1 time: 0.155432 May 27 09:44:01.294895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 325/642] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:01 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:02.312974 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fbfc4efd-b979-4c0e-ad32-01d7e1e8b969 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:02.313586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fbfc4efd-b979-4c0e-ad32-01d7e1e8b969 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:02.320198 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fbfc4efd-b979-4c0e-ad32-01d7e1e8b969 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:02.320649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fbfc4efd-b979-4c0e-ad32-01d7e1e8b969 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:02.321454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fbfc4efd-b979-4c0e-ad32-01d7e1e8b969 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:02.321889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fbfc4efd-b979-4c0e-ad32-01d7e1e8b969 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:02.450860 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fbfc4efd-b979-4c0e-ad32-01d7e1e8b969 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:02.459598 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fbfc4efd-b979-4c0e-ad32-01d7e1e8b969 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1691 microversion: 2.1 time: 0.151131 May 27 09:44:02.460174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 318/643] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:02 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1691 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:44:03.476917 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-269fe63c-c77a-4250-abe9-603ba067f7e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:03.477519 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-269fe63c-c77a-4250-abe9-603ba067f7e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:03.484306 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-269fe63c-c77a-4250-abe9-603ba067f7e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:03.484755 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-269fe63c-c77a-4250-abe9-603ba067f7e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:03.485520 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-269fe63c-c77a-4250-abe9-603ba067f7e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:03.485950 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-269fe63c-c77a-4250-abe9-603ba067f7e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:03.582550 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-269fe63c-c77a-4250-abe9-603ba067f7e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:03.590319 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-269fe63c-c77a-4250-abe9-603ba067f7e0 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1623 microversion: 2.1 time: 0.117208 May 27 09:44:03.590904 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 326/644] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:03 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1623 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:03.802623 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-df63d10b-a589-4828-bfe1-a592ce93fffe req-b81c9731-6040-4977-8ef3-558e4ca734b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b03ea7-b697-47df-898f-33d7f45ab279", "name": "network-vif-deleted", "tag": "e00cf8d3-9ed6-423d-8c16-e7f1a0445c42"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:03.813176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-df63d10b-a589-4828-bfe1-a592ce93fffe req-b81c9731-6040-4977-8ef3-558e4ca734b5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:03.813935 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-df63d10b-a589-4828-bfe1-a592ce93fffe req-b81c9731-6040-4977-8ef3-558e4ca734b5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:03.830133 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-df63d10b-a589-4828-bfe1-a592ce93fffe req-b81c9731-6040-4977-8ef3-558e4ca734b5 service nova] Creating event network-vif-deleted:e00cf8d3-9ed6-423d-8c16-e7f1a0445c42 for instance 28b03ea7-b697-47df-898f-33d7f45ab279 on hv-cinder-82549 May 27 09:44:03.835733 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-df63d10b-a589-4828-bfe1-a592ce93fffe req-b81c9731-6040-4977-8ef3-558e4ca734b5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037167 May 27 09:44:03.836745 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 319/645] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:44:04.609794 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:04.610472 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:04.618703 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:04.619510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:04.620318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:04.620755 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:04.659410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:04.659866 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:04.661651 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lazy-loading 'fault' on Instance uuid 28b03ea7-b697-47df-898f-33d7f45ab279 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:44:04.706486 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:04.717342 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-012b6ac0-5042-43e9-a7d4-e3c671154ae2 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 200 len: 1336 microversion: 2.1 time: 0.112190 May 27 09:44:04.717937 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 327/646] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:04 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 1336 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:05.739649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-65f32103-c0b3-466d-b7d9-2e391f43ab0e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:05.740249 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-65f32103-c0b3-466d-b7d9-2e391f43ab0e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 28b03ea7-b697-47df-898f-33d7f45ab279] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:05.746999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-65f32103-c0b3-466d-b7d9-2e391f43ab0e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:05.747517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-65f32103-c0b3-466d-b7d9-2e391f43ab0e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:05.748341 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-65f32103-c0b3-466d-b7d9-2e391f43ab0e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:05.748771 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-65f32103-c0b3-466d-b7d9-2e391f43ab0e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:05.762871 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-65f32103-c0b3-466d-b7d9-2e391f43ab0e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] HTTP exception thrown: Instance 28b03ea7-b697-47df-898f-33d7f45ab279 could not be found. May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-65f32103-c0b3-466d-b7d9-2e391f43ab0e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Request method failure captured: May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 HTTP/1.1 May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJvuSI5jHOqY2C1Tp2SCsB1rovkIRjm2wJf4hz65RNutH_SPrQoDBkvp0GnBa3AUQB1hA-TWNGKN5vDSdhd3DdQEXVS7iqHQ-4OVc0ILrDoxM-uFCx9uwEsold8dkXD1jI6-jlu--3Znf24skIggPZiAjJ6EEkZ7sKpSagXNJ2tfeoI May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 91f6b3c676a84127989cc8e35ce91de1 May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:44:05.764514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91f6b3c676a84127989cc8e35ce91de1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 91f6b3c676a84127989cc8e35ce91de1 May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-ServerRescueNegativeTestJSON-916011391-project May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 5132dcb5580d44e1bc2c7cf4a6893678 May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-ServerRescueNegativeTestJSON-916011391-project May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 28b03ea7-b697-47df-898f-33d7f45ab279 could not be found. May 27 09:44:05.766153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '28b03ea7-b697-47df-898f-33d7f45ab279'} May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b03ea7-b697-47df-898f-33d7f45ab279 could not be found. May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:44:05.767168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b03ea7-b697-47df-898f-33d7f45ab279 could not be found. May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b03ea7-b697-47df-898f-33d7f45ab279 could not be found. May 27 09:44:05.768825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:44:05.770241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-65f32103-c0b3-466d-b7d9-2e391f43ab0e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Returning 404 to user: Instance 28b03ea7-b697-47df-898f-33d7f45ab279 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:44:05.770241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-65f32103-c0b3-466d-b7d9-2e391f43ab0e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279" status: 404 len: 111 microversion: 2.1 time: 0.030667 May 27 09:44:05.770241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 320/647] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:05 2022] GET /compute/v2.1/servers/28b03ea7-b697-47df-898f-33d7f45ab279 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:44:05.774856 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-947cfb08-bebc-499b-a9c9-df08d5912b46 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '.version_select at 0x7fbe3225bdc0>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:05.905741 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-947cfb08-bebc-499b-a9c9-df08d5912b46 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527290638" status: 202 len: 0 microversion: 2.1 time: 0.134580 May 27 09:44:05.906977 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 328/648] 10.222.0.48 () {58 vars in 1220 bytes} [Fri May 27 09:44:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1527290638 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:44:09.369369 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b7f50587-5766-457b-b345-a9e831efe11b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:09.369889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b7f50587-5766-457b-b345-a9e831efe11b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:09.377153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b7f50587-5766-457b-b345-a9e831efe11b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:09.377611 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b7f50587-5766-457b-b345-a9e831efe11b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:09.378406 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b7f50587-5766-457b-b345-a9e831efe11b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:09.378851 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b7f50587-5766-457b-b345-a9e831efe11b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:09.404461 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b7f50587-5766-457b-b345-a9e831efe11b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:44:09.778635 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b7f50587-5766-457b-b345-a9e831efe11b tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 204 len: 0 microversion: 2.1 time: 0.412802 May 27 09:44:09.779224 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 321/649] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:44:09 2022] DELETE /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:44:09.787991 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-17896fcc-5640-45f2-a5c5-8b46baf51858 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:09.788645 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-17896fcc-5640-45f2-a5c5-8b46baf51858 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:09.798212 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-17896fcc-5640-45f2-a5c5-8b46baf51858 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:09.798212 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-17896fcc-5640-45f2-a5c5-8b46baf51858 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:09.798212 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-17896fcc-5640-45f2-a5c5-8b46baf51858 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:09.798212 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-17896fcc-5640-45f2-a5c5-8b46baf51858 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:09.924562 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-17896fcc-5640-45f2-a5c5-8b46baf51858 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:09.932071 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-17896fcc-5640-45f2-a5c5-8b46baf51858 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1507 microversion: 2.1 time: 0.148605 May 27 09:44:09.932635 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 329/650] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:09 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:10.950350 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-778d2c2b-99b9-4bcf-a8b2-74a06e26178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:10.950971 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-778d2c2b-99b9-4bcf-a8b2-74a06e26178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:10.957451 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-778d2c2b-99b9-4bcf-a8b2-74a06e26178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:10.957901 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-778d2c2b-99b9-4bcf-a8b2-74a06e26178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:10.958760 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-778d2c2b-99b9-4bcf-a8b2-74a06e26178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:10.959194 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-778d2c2b-99b9-4bcf-a8b2-74a06e26178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:11.049006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-778d2c2b-99b9-4bcf-a8b2-74a06e26178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:11.058698 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-778d2c2b-99b9-4bcf-a8b2-74a06e26178e tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1465 microversion: 2.1 time: 0.112474 May 27 09:44:11.059835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 322/651] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:10 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1465 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:11.066345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-9868a751-ff03-4c68-84a2-6ea150f2498f req-df9abc76-d7c7-49e7-bd12-cea9d16ae4e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1157d082-4c13-4fab-b589-01c5914c6e4e", "name": "network-vif-deleted", "tag": "15635276-b81e-4d82-b303-62039515d454"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:11.075592 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-9868a751-ff03-4c68-84a2-6ea150f2498f req-df9abc76-d7c7-49e7-bd12-cea9d16ae4e5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:11.076276 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-9868a751-ff03-4c68-84a2-6ea150f2498f req-df9abc76-d7c7-49e7-bd12-cea9d16ae4e5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:11.088173 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-9868a751-ff03-4c68-84a2-6ea150f2498f req-df9abc76-d7c7-49e7-bd12-cea9d16ae4e5 service nova] Creating event network-vif-deleted:15635276-b81e-4d82-b303-62039515d454 for instance 1157d082-4c13-4fab-b589-01c5914c6e4e on hv-cinder-82549 May 27 09:44:11.093255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-9868a751-ff03-4c68-84a2-6ea150f2498f req-df9abc76-d7c7-49e7-bd12-cea9d16ae4e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030934 May 27 09:44:11.093985 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 330/652] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:44:12.075742 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:12.076449 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:12.083912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:12.084397 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:12.085229 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:12.085658 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:12.119265 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:12.119684 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:12.120113 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lazy-loading 'fault' on Instance uuid 1157d082-4c13-4fab-b589-01c5914c6e4e {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:44:12.163332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:12.170800 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a999f635-fdaa-42d2-aea0-ce268338fe4f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 200 len: 1311 microversion: 2.1 time: 0.099187 May 27 09:44:12.171405 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 323/653] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:12 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:13.189568 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a1ac0a6a-758f-405b-ad6b-49de917083a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:13.190292 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a1ac0a6a-758f-405b-ad6b-49de917083a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1157d082-4c13-4fab-b589-01c5914c6e4e] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:13.204655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a1ac0a6a-758f-405b-ad6b-49de917083a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:13.205107 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a1ac0a6a-758f-405b-ad6b-49de917083a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:13.205922 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a1ac0a6a-758f-405b-ad6b-49de917083a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:13.206407 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a1ac0a6a-758f-405b-ad6b-49de917083a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:13.220935 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-a1ac0a6a-758f-405b-ad6b-49de917083a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] HTTP exception thrown: Instance 1157d082-4c13-4fab-b589-01c5914c6e4e could not be found. May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a1ac0a6a-758f-405b-ad6b-49de917083a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Request method failure captured: May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e HTTP/1.1 May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJvuSI5jHOqY2C1Tp2SCsB1rovkIRjm2wJf4hz65RNutH_SPrQoDBkvp0GnBa3AUQB1hA-TWNGKN5vDSdhd3DdQEXVS7iqHQ-4OVc0ILrDoxM-uFCx9uwEsold8dkXD1jI6-jlu--3Znf24skIggPZiAjJ6EEkZ7sKpSagXNJ2tfeoI May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 91f6b3c676a84127989cc8e35ce91de1 May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:44:13.222603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91f6b3c676a84127989cc8e35ce91de1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 91f6b3c676a84127989cc8e35ce91de1 May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-ServerRescueNegativeTestJSON-916011391-project May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 5132dcb5580d44e1bc2c7cf4a6893678 May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-ServerRescueNegativeTestJSON-916011391-project May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 1157d082-4c13-4fab-b589-01c5914c6e4e could not be found. May 27 09:44:13.224235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '1157d082-4c13-4fab-b589-01c5914c6e4e'} May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1157d082-4c13-4fab-b589-01c5914c6e4e could not be found. May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:44:13.225846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1157d082-4c13-4fab-b589-01c5914c6e4e could not be found. May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1157d082-4c13-4fab-b589-01c5914c6e4e could not be found. May 27 09:44:13.227369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:44:13.228668 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a1ac0a6a-758f-405b-ad6b-49de917083a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Returning 404 to user: Instance 1157d082-4c13-4fab-b589-01c5914c6e4e could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:44:13.228668 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a1ac0a6a-758f-405b-ad6b-49de917083a5 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e" status: 404 len: 111 microversion: 2.1 time: 0.039455 May 27 09:44:13.228668 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 331/654] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:13 2022] GET /compute/v2.1/servers/1157d082-4c13-4fab-b589-01c5914c6e4e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:44:13.232621 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ec365870-de58-4420-8e2a-5321c2c3a11f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:13.233110 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ec365870-de58-4420-8e2a-5321c2c3a11f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:13.240510 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ec365870-de58-4420-8e2a-5321c2c3a11f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:13.240949 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ec365870-de58-4420-8e2a-5321c2c3a11f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:13.241700 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ec365870-de58-4420-8e2a-5321c2c3a11f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:13.242129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ec365870-de58-4420-8e2a-5321c2c3a11f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:13.267074 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ec365870-de58-4420-8e2a-5321c2c3a11f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:44:13.729639 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ec365870-de58-4420-8e2a-5321c2c3a11f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 204 len: 0 microversion: 2.1 time: 0.500505 May 27 09:44:13.730309 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 324/655] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:44:13 2022] DELETE /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:44:13.738681 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-256cfc0f-4d4a-413c-a943-d2c147ab159f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:13.739290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-256cfc0f-4d4a-413c-a943-d2c147ab159f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:13.745386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-256cfc0f-4d4a-413c-a943-d2c147ab159f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:13.745833 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-256cfc0f-4d4a-413c-a943-d2c147ab159f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:13.746623 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-256cfc0f-4d4a-413c-a943-d2c147ab159f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:13.747065 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-256cfc0f-4d4a-413c-a943-d2c147ab159f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:13.877957 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-256cfc0f-4d4a-413c-a943-d2c147ab159f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:13.885638 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-256cfc0f-4d4a-413c-a943-d2c147ab159f tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.150888 May 27 09:44:13.886211 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 332/656] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:13 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:14.903621 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-61ae3931-3d34-4fe6-a2df-ab9ac1bffab6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:14.904254 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-61ae3931-3d34-4fe6-a2df-ab9ac1bffab6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:14.911923 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-61ae3931-3d34-4fe6-a2df-ab9ac1bffab6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:14.912379 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-61ae3931-3d34-4fe6-a2df-ab9ac1bffab6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:14.913221 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-61ae3931-3d34-4fe6-a2df-ab9ac1bffab6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:14.913660 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-61ae3931-3d34-4fe6-a2df-ab9ac1bffab6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:15.042227 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-61ae3931-3d34-4fe6-a2df-ab9ac1bffab6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:15.045704 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:15.050899 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-61ae3931-3d34-4fe6-a2df-ab9ac1bffab6 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.151560 May 27 09:44:15.051477 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 325/657] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:14 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:16.068884 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b2b688d6-442f-4cd7-abd0-954322f7bdc8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:16.069590 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b2b688d6-442f-4cd7-abd0-954322f7bdc8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:16.076178 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b2b688d6-442f-4cd7-abd0-954322f7bdc8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:16.076629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b2b688d6-442f-4cd7-abd0-954322f7bdc8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:16.077393 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b2b688d6-442f-4cd7-abd0-954322f7bdc8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:16.078474 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b2b688d6-442f-4cd7-abd0-954322f7bdc8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:16.206714 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b2b688d6-442f-4cd7-abd0-954322f7bdc8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:16.214247 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b2b688d6-442f-4cd7-abd0-954322f7bdc8 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1522 microversion: 2.1 time: 0.149247 May 27 09:44:16.215369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 333/658] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:16 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:16.892795 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-eb975aff-360a-4139-8be9-c31eafc6f65c req-a39e7514-1593-4858-929a-a289cdf0c644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f3d6419-841c-47ae-8564-c770ed395103", "name": "network-vif-deleted", "tag": "4ebea354-29fe-4bee-8b8d-9d44bd56ea2a"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:16.902466 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-eb975aff-360a-4139-8be9-c31eafc6f65c req-a39e7514-1593-4858-929a-a289cdf0c644 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:16.902917 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-eb975aff-360a-4139-8be9-c31eafc6f65c req-a39e7514-1593-4858-929a-a289cdf0c644 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:16.915135 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-eb975aff-360a-4139-8be9-c31eafc6f65c req-a39e7514-1593-4858-929a-a289cdf0c644 service nova] Creating event network-vif-deleted:4ebea354-29fe-4bee-8b8d-9d44bd56ea2a for instance 1f3d6419-841c-47ae-8564-c770ed395103 on hv-cinder-82549 May 27 09:44:16.919951 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-eb975aff-360a-4139-8be9-c31eafc6f65c req-a39e7514-1593-4858-929a-a289cdf0c644 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031476 May 27 09:44:16.920551 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 326/659] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:44:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:44:17.232127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:17.232730 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:17.239600 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:17.240046 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:17.240848 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:17.241293 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:17.282117 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:17.282859 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:17.283311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lazy-loading 'fault' on Instance uuid 1f3d6419-841c-47ae-8564-c770ed395103 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:44:17.324699 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5132dcb5580d44e1bc2c7cf4a6893678', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91f6b3c676a84127989cc8e35ce91de1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:17.337072 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-75f845d5-8ee9-435d-be4c-78c86bf63a61 tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 200 len: 1312 microversion: 2.1 time: 0.108796 May 27 09:44:17.339049 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 334/660] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:17 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 1312 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:44:18.355606 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a32407b5-6934-490e-b353-a551e320be4a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:18.356332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a32407b5-6934-490e-b353-a551e320be4a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] [instance: 1f3d6419-841c-47ae-8564-c770ed395103] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:18.362778 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a32407b5-6934-490e-b353-a551e320be4a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:18.363242 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a32407b5-6934-490e-b353-a551e320be4a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:18.363979 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a32407b5-6934-490e-b353-a551e320be4a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:18.364429 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a32407b5-6934-490e-b353-a551e320be4a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:18.378213 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-a32407b5-6934-490e-b353-a551e320be4a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] HTTP exception thrown: Instance 1f3d6419-841c-47ae-8564-c770ed395103 could not be found. May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a32407b5-6934-490e-b353-a551e320be4a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Request method failure captured: May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 HTTP/1.1 May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJvuSI5jHOqY2C1Tp2SCsB1rovkIRjm2wJf4hz65RNutH_SPrQoDBkvp0GnBa3AUQB1hA-TWNGKN5vDSdhd3DdQEXVS7iqHQ-4OVc0ILrDoxM-uFCx9uwEsold8dkXD1jI6-jlu--3Znf24skIggPZiAjJ6EEkZ7sKpSagXNJ2tfeoI May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 91f6b3c676a84127989cc8e35ce91de1 May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:44:18.379825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/91f6b3c676a84127989cc8e35ce91de1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_91f6b3c676a84127989cc8e35ce91de1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 91f6b3c676a84127989cc8e35ce91de1 May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-916011391 May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-ServerRescueNegativeTestJSON-916011391-project May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 5132dcb5580d44e1bc2c7cf4a6893678 May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-ServerRescueNegativeTestJSON-916011391-project May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 1f3d6419-841c-47ae-8564-c770ed395103 could not be found. May 27 09:44:18.381338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '1f3d6419-841c-47ae-8564-c770ed395103'} May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f3d6419-841c-47ae-8564-c770ed395103 could not be found. May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:44:18.382174 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f3d6419-841c-47ae-8564-c770ed395103 could not be found. May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f3d6419-841c-47ae-8564-c770ed395103 could not be found. May 27 09:44:18.383601 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:44:18.384952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a32407b5-6934-490e-b353-a551e320be4a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] Returning 404 to user: Instance 1f3d6419-841c-47ae-8564-c770ed395103 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:44:18.384952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a32407b5-6934-490e-b353-a551e320be4a tempest-ServerRescueNegativeTestJSON-916011391 tempest-ServerRescueNegativeTestJSON-916011391-project] 10.222.0.48 "GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103" status: 404 len: 111 microversion: 2.1 time: 0.030914 May 27 09:44:18.384952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 327/661] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:44:18 2022] GET /compute/v2.1/servers/1f3d6419-841c-47ae-8564-c770ed395103 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:44:22.859890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-20e68b39-3fd3-4c83-868d-8416d8a13ae0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:22.860480 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-20e68b39-3fd3-4c83-868d-8416d8a13ae0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:22.866824 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-20e68b39-3fd3-4c83-868d-8416d8a13ae0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:22.867264 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-20e68b39-3fd3-4c83-868d-8416d8a13ae0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:22.868048 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-20e68b39-3fd3-4c83-868d-8416d8a13ae0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:22.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-20e68b39-3fd3-4c83-868d-8416d8a13ae0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:22.894274 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-20e68b39-3fd3-4c83-868d-8416d8a13ae0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/ips" status: 200 len: 151 microversion: 2.20 time: 0.039138 May 27 09:44:22.894929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 335/662] 10.222.0.48 () {60 vars in 1288 bytes} [Fri May 27 09:44:22 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:44:26.336720 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6d2084d0-180c-42ff-9c90-94b2e527e5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:26.337346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6d2084d0-180c-42ff-9c90-94b2e527e5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:26.345093 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6d2084d0-180c-42ff-9c90-94b2e527e5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:26.345542 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6d2084d0-180c-42ff-9c90-94b2e527e5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:26.346344 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6d2084d0-180c-42ff-9c90-94b2e527e5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:26.346764 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6d2084d0-180c-42ff-9c90-94b2e527e5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:26.371605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-6d2084d0-180c-42ff-9c90-94b2e527e5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lazy-loading 'flavor' on Instance uuid c5509199-188d-42fe-9ba4-86939ff60815 {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:44:27.193356 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6d2084d0-180c-42ff-9c90-94b2e527e5c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "POST /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/action" status: 202 len: 0 microversion: 2.20 time: 0.863649 May 27 09:44:27.193972 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 328/663] 10.222.0.48 () {62 vars in 1318 bytes} [Fri May 27 09:44:26 2022] POST /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/action => generated 0 bytes in 867 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 09:44:27.205519 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-94c8a63a-3d62-4529-b5ed-00d3215d3311 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:27.211473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-94c8a63a-3d62-4529-b5ed-00d3215d3311 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:27.215237 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-94c8a63a-3d62-4529-b5ed-00d3215d3311 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:27.215934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-94c8a63a-3d62-4529-b5ed-00d3215d3311 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:27.217322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-94c8a63a-3d62-4529-b5ed-00d3215d3311 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:27.218421 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-94c8a63a-3d62-4529-b5ed-00d3215d3311 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:27.369326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-94c8a63a-3d62-4529-b5ed-00d3215d3311 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:27.379620 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-94c8a63a-3d62-4529-b5ed-00d3215d3311 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:27.381267 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-94c8a63a-3d62-4529-b5ed-00d3215d3311 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:27.382494 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-94c8a63a-3d62-4529-b5ed-00d3215d3311 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.184243 May 27 09:44:27.383059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 336/664] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:27 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:28.404427 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c257aa6e-8502-42fa-8458-d6c920403db9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:28.405210 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c257aa6e-8502-42fa-8458-d6c920403db9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:28.407222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:28.412189 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c257aa6e-8502-42fa-8458-d6c920403db9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:28.412629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c257aa6e-8502-42fa-8458-d6c920403db9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:28.413383 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c257aa6e-8502-42fa-8458-d6c920403db9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:28.413813 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c257aa6e-8502-42fa-8458-d6c920403db9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:28.564047 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c257aa6e-8502-42fa-8458-d6c920403db9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:28.573034 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c257aa6e-8502-42fa-8458-d6c920403db9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:28.574565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c257aa6e-8502-42fa-8458-d6c920403db9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:28.575734 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c257aa6e-8502-42fa-8458-d6c920403db9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.177373 May 27 09:44:28.576293 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 329/665] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:28 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:29.594477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4540e55a-41c0-4b3a-a0fa-25cf45c8e9c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:29.595099 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4540e55a-41c0-4b3a-a0fa-25cf45c8e9c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:29.597712 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=36,nova_api:DELETE=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:29.602923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4540e55a-41c0-4b3a-a0fa-25cf45c8e9c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:29.603375 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4540e55a-41c0-4b3a-a0fa-25cf45c8e9c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:29.604165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4540e55a-41c0-4b3a-a0fa-25cf45c8e9c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:29.604600 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4540e55a-41c0-4b3a-a0fa-25cf45c8e9c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:29.607636 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=79 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:29.746346 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4540e55a-41c0-4b3a-a0fa-25cf45c8e9c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:29.755246 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4540e55a-41c0-4b3a-a0fa-25cf45c8e9c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:29.756748 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4540e55a-41c0-4b3a-a0fa-25cf45c8e9c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:29.757910 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4540e55a-41c0-4b3a-a0fa-25cf45c8e9c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.167574 May 27 09:44:29.758532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 337/666] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:29 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:30.779081 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-eaed85c7-b93e-4b84-8027-4938a83291ce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:30.779768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-eaed85c7-b93e-4b84-8027-4938a83291ce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:30.788012 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eaed85c7-b93e-4b84-8027-4938a83291ce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:30.788459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eaed85c7-b93e-4b84-8027-4938a83291ce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:30.789241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eaed85c7-b93e-4b84-8027-4938a83291ce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:30.789691 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eaed85c7-b93e-4b84-8027-4938a83291ce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:30.945757 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-eaed85c7-b93e-4b84-8027-4938a83291ce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:30.954548 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-eaed85c7-b93e-4b84-8027-4938a83291ce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:30.956089 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-eaed85c7-b93e-4b84-8027-4938a83291ce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:30.957421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-eaed85c7-b93e-4b84-8027-4938a83291ce tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.184201 May 27 09:44:30.957993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 330/667] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:30 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:31.977125 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-699e7db3-0623-437e-b3c4-c314fcbc4658 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:31.977747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-699e7db3-0623-437e-b3c4-c314fcbc4658 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:31.984287 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-699e7db3-0623-437e-b3c4-c314fcbc4658 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:31.984728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-699e7db3-0623-437e-b3c4-c314fcbc4658 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:31.985488 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-699e7db3-0623-437e-b3c4-c314fcbc4658 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:31.985917 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-699e7db3-0623-437e-b3c4-c314fcbc4658 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:32.125896 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-699e7db3-0623-437e-b3c4-c314fcbc4658 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:32.134061 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-699e7db3-0623-437e-b3c4-c314fcbc4658 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:32.135577 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-699e7db3-0623-437e-b3c4-c314fcbc4658 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:32.136735 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-699e7db3-0623-437e-b3c4-c314fcbc4658 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.163707 May 27 09:44:32.137293 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 338/668] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:31 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:33.156020 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-733267a5-e718-475a-bbe8-83a0844d24d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:33.156722 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-733267a5-e718-475a-bbe8-83a0844d24d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:33.163313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-733267a5-e718-475a-bbe8-83a0844d24d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:33.163758 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-733267a5-e718-475a-bbe8-83a0844d24d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:33.164526 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-733267a5-e718-475a-bbe8-83a0844d24d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:33.164957 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-733267a5-e718-475a-bbe8-83a0844d24d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:33.297961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-733267a5-e718-475a-bbe8-83a0844d24d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:33.306512 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-733267a5-e718-475a-bbe8-83a0844d24d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:33.308007 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-733267a5-e718-475a-bbe8-83a0844d24d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:33.312232 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-733267a5-e718-475a-bbe8-83a0844d24d1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.158093 May 27 09:44:33.312232 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 331/669] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:33 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:34.334225 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-fe056dd9-b254-4fba-9abd-877331c2651c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:34.334225 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-fe056dd9-b254-4fba-9abd-877331c2651c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:34.337965 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe056dd9-b254-4fba-9abd-877331c2651c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:34.338526 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe056dd9-b254-4fba-9abd-877331c2651c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:34.339629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe056dd9-b254-4fba-9abd-877331c2651c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:34.340447 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe056dd9-b254-4fba-9abd-877331c2651c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:34.488896 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fe056dd9-b254-4fba-9abd-877331c2651c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:34.497442 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fe056dd9-b254-4fba-9abd-877331c2651c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:34.499094 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fe056dd9-b254-4fba-9abd-877331c2651c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:34.500296 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-fe056dd9-b254-4fba-9abd-877331c2651c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.175623 May 27 09:44:34.500894 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 339/670] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:34 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:44:35.519708 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b072cc2c-0bf0-4a5e-ac37-81df2967de95 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:35.520319 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b072cc2c-0bf0-4a5e-ac37-81df2967de95 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:35.526921 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b072cc2c-0bf0-4a5e-ac37-81df2967de95 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:35.527372 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b072cc2c-0bf0-4a5e-ac37-81df2967de95 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:35.528143 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b072cc2c-0bf0-4a5e-ac37-81df2967de95 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:35.528580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b072cc2c-0bf0-4a5e-ac37-81df2967de95 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:35.669345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b072cc2c-0bf0-4a5e-ac37-81df2967de95 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:35.678114 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b072cc2c-0bf0-4a5e-ac37-81df2967de95 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:35.679783 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b072cc2c-0bf0-4a5e-ac37-81df2967de95 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:35.681279 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b072cc2c-0bf0-4a5e-ac37-81df2967de95 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.165206 May 27 09:44:35.681546 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 332/671] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:35 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:36.699948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a489a27d-f4be-462e-a33a-af84c942820c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:36.700469 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a489a27d-f4be-462e-a33a-af84c942820c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:36.707447 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a489a27d-f4be-462e-a33a-af84c942820c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:36.707892 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a489a27d-f4be-462e-a33a-af84c942820c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:36.708672 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a489a27d-f4be-462e-a33a-af84c942820c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:36.709098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a489a27d-f4be-462e-a33a-af84c942820c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:36.847241 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a489a27d-f4be-462e-a33a-af84c942820c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:36.855649 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a489a27d-f4be-462e-a33a-af84c942820c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:36.857137 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a489a27d-f4be-462e-a33a-af84c942820c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:36.858323 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a489a27d-f4be-462e-a33a-af84c942820c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.162342 May 27 09:44:36.858878 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 340/672] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:36 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:37.877130 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e4e0d2a4-10a0-4d14-981e-a64940cad547 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:37.877914 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e4e0d2a4-10a0-4d14-981e-a64940cad547 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:37.884972 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e4e0d2a4-10a0-4d14-981e-a64940cad547 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:37.885415 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e4e0d2a4-10a0-4d14-981e-a64940cad547 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:37.886285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e4e0d2a4-10a0-4d14-981e-a64940cad547 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:37.886798 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e4e0d2a4-10a0-4d14-981e-a64940cad547 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:38.056530 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e4e0d2a4-10a0-4d14-981e-a64940cad547 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:38.073059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e4e0d2a4-10a0-4d14-981e-a64940cad547 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:38.076053 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e4e0d2a4-10a0-4d14-981e-a64940cad547 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:38.079190 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e4e0d2a4-10a0-4d14-981e-a64940cad547 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.205475 May 27 09:44:38.080401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 333/673] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:37 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:39.100718 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f85b01a3-442e-4cf3-8418-da75a27923c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:39.101352 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f85b01a3-442e-4cf3-8418-da75a27923c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:39.108167 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f85b01a3-442e-4cf3-8418-da75a27923c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:39.108662 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f85b01a3-442e-4cf3-8418-da75a27923c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:39.109435 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f85b01a3-442e-4cf3-8418-da75a27923c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:39.109877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f85b01a3-442e-4cf3-8418-da75a27923c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:39.251727 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f85b01a3-442e-4cf3-8418-da75a27923c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:39.260148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f85b01a3-442e-4cf3-8418-da75a27923c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:39.261701 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f85b01a3-442e-4cf3-8418-da75a27923c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:39.263037 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f85b01a3-442e-4cf3-8418-da75a27923c0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.166254 May 27 09:44:39.263458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 341/674] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:39 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:40.281178 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-456d4c95-6e77-4ece-bf64-48fd9a231166 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:40.285130 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-456d4c95-6e77-4ece-bf64-48fd9a231166 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:40.288477 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-456d4c95-6e77-4ece-bf64-48fd9a231166 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:40.288920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-456d4c95-6e77-4ece-bf64-48fd9a231166 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:40.289685 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-456d4c95-6e77-4ece-bf64-48fd9a231166 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:40.290118 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-456d4c95-6e77-4ece-bf64-48fd9a231166 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:40.429520 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-456d4c95-6e77-4ece-bf64-48fd9a231166 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:40.438835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-456d4c95-6e77-4ece-bf64-48fd9a231166 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:40.440346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-456d4c95-6e77-4ece-bf64-48fd9a231166 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:40.441537 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-456d4c95-6e77-4ece-bf64-48fd9a231166 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.164384 May 27 09:44:40.442104 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 334/675] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:40 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:41.460088 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a76ab727-6847-4312-a340-ba5b05e36fbe tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:41.460695 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a76ab727-6847-4312-a340-ba5b05e36fbe tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:41.467886 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a76ab727-6847-4312-a340-ba5b05e36fbe tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:41.468356 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a76ab727-6847-4312-a340-ba5b05e36fbe tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:41.469107 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a76ab727-6847-4312-a340-ba5b05e36fbe tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:41.469548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a76ab727-6847-4312-a340-ba5b05e36fbe tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:41.609386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a76ab727-6847-4312-a340-ba5b05e36fbe tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:41.618268 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a76ab727-6847-4312-a340-ba5b05e36fbe tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:41.619879 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a76ab727-6847-4312-a340-ba5b05e36fbe tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:41.621062 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a76ab727-6847-4312-a340-ba5b05e36fbe tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.165017 May 27 09:44:41.621622 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 342/676] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:41 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:42.641160 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e847b9bf-4eb8-43f4-ad76-412fffc678e5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:42.641804 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e847b9bf-4eb8-43f4-ad76-412fffc678e5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:42.648692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e847b9bf-4eb8-43f4-ad76-412fffc678e5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:42.649208 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e847b9bf-4eb8-43f4-ad76-412fffc678e5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:42.650136 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e847b9bf-4eb8-43f4-ad76-412fffc678e5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:42.650622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e847b9bf-4eb8-43f4-ad76-412fffc678e5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:42.800885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e847b9bf-4eb8-43f4-ad76-412fffc678e5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:42.809842 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e847b9bf-4eb8-43f4-ad76-412fffc678e5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:42.811523 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e847b9bf-4eb8-43f4-ad76-412fffc678e5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:42.812803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e847b9bf-4eb8-43f4-ad76-412fffc678e5 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.176443 May 27 09:44:42.813756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 335/677] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:42 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:43.832233 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-77b974db-9999-4fd6-996c-61fc949f9be0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:43.833090 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-77b974db-9999-4fd6-996c-61fc949f9be0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:43.840209 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-77b974db-9999-4fd6-996c-61fc949f9be0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:43.840761 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-77b974db-9999-4fd6-996c-61fc949f9be0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:43.841619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-77b974db-9999-4fd6-996c-61fc949f9be0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:43.842131 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-77b974db-9999-4fd6-996c-61fc949f9be0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:43.997528 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-77b974db-9999-4fd6-996c-61fc949f9be0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:44.007208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-77b974db-9999-4fd6-996c-61fc949f9be0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:44.008716 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-77b974db-9999-4fd6-996c-61fc949f9be0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:44.009918 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-77b974db-9999-4fd6-996c-61fc949f9be0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1743 microversion: 2.20 time: 0.181842 May 27 09:44:44.015358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 343/678] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:43 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1743 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:45.031438 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-41c71744-0667-4f6e-bcbf-42745f866ef0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:45.032262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-41c71744-0667-4f6e-bcbf-42745f866ef0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:45.040530 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-41c71744-0667-4f6e-bcbf-42745f866ef0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:45.040985 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-41c71744-0667-4f6e-bcbf-42745f866ef0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:45.041773 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-41c71744-0667-4f6e-bcbf-42745f866ef0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:45.042225 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-41c71744-0667-4f6e-bcbf-42745f866ef0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:45.213359 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-41c71744-0667-4f6e-bcbf-42745f866ef0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:45.224513 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-41c71744-0667-4f6e-bcbf-42745f866ef0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:45.227151 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-41c71744-0667-4f6e-bcbf-42745f866ef0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:45.228379 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-41c71744-0667-4f6e-bcbf-42745f866ef0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1743 microversion: 2.20 time: 0.203081 May 27 09:44:45.228957 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 336/679] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:45 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:46.248208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-62a6ee13-1013-45a5-b91b-3797449f6dec tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:46.249935 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-62a6ee13-1013-45a5-b91b-3797449f6dec tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:46.256673 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-62a6ee13-1013-45a5-b91b-3797449f6dec tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:46.261454 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-62a6ee13-1013-45a5-b91b-3797449f6dec tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:46.261454 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-62a6ee13-1013-45a5-b91b-3797449f6dec tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:46.261454 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-62a6ee13-1013-45a5-b91b-3797449f6dec tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:46.399654 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-62a6ee13-1013-45a5-b91b-3797449f6dec tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:46.412348 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-62a6ee13-1013-45a5-b91b-3797449f6dec tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:46.413871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-62a6ee13-1013-45a5-b91b-3797449f6dec tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:46.415085 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-62a6ee13-1013-45a5-b91b-3797449f6dec tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1743 microversion: 2.20 time: 0.170937 May 27 09:44:46.415655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 344/680] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:46 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:47.436860 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bf240390-1d9b-4520-829e-0c696a4f7aae tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:47.437861 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bf240390-1d9b-4520-829e-0c696a4f7aae tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:47.445635 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bf240390-1d9b-4520-829e-0c696a4f7aae tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:47.448418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bf240390-1d9b-4520-829e-0c696a4f7aae tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:47.448418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bf240390-1d9b-4520-829e-0c696a4f7aae tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:47.448418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bf240390-1d9b-4520-829e-0c696a4f7aae tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:47.584587 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bf240390-1d9b-4520-829e-0c696a4f7aae tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:47.593835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bf240390-1d9b-4520-829e-0c696a4f7aae tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:47.595374 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bf240390-1d9b-4520-829e-0c696a4f7aae tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:47.596574 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bf240390-1d9b-4520-829e-0c696a4f7aae tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1743 microversion: 2.20 time: 0.166225 May 27 09:44:47.597196 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 337/681] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:47 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:48.615618 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d6d6c4a4-d126-458c-b512-951c80e9c272 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:48.616287 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d6d6c4a4-d126-458c-b512-951c80e9c272 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:48.622668 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d6d6c4a4-d126-458c-b512-951c80e9c272 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:48.623131 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d6d6c4a4-d126-458c-b512-951c80e9c272 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:48.624492 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d6d6c4a4-d126-458c-b512-951c80e9c272 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:48.624968 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d6d6c4a4-d126-458c-b512-951c80e9c272 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:48.751743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-285cc0e6-3c19-43f0-8dbe-46716dfe56a9 req-c1cb38b8-b84d-4132-a111-c9f9c1471d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5509199-188d-42fe-9ba4-86939ff60815", "name": "network-vif-plugged", "status": "completed", "tag": "b4210cbf-916a-49c1-8183-605e8128c6d0"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:44:48.763609 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-285cc0e6-3c19-43f0-8dbe-46716dfe56a9 req-c1cb38b8-b84d-4132-a111-c9f9c1471d73 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:48.764175 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-285cc0e6-3c19-43f0-8dbe-46716dfe56a9 req-c1cb38b8-b84d-4132-a111-c9f9c1471d73 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:48.768467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d6d6c4a4-d126-458c-b512-951c80e9c272 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:48.776387 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-285cc0e6-3c19-43f0-8dbe-46716dfe56a9 req-c1cb38b8-b84d-4132-a111-c9f9c1471d73 service nova] Creating event network-vif-plugged:b4210cbf-916a-49c1-8183-605e8128c6d0 for instance c5509199-188d-42fe-9ba4-86939ff60815 on hv-cinder-82549 May 27 09:44:48.776892 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d6d6c4a4-d126-458c-b512-951c80e9c272 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:48.778438 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d6d6c4a4-d126-458c-b512-951c80e9c272 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:48.780523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d6d6c4a4-d126-458c-b512-951c80e9c272 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1743 microversion: 2.20 time: 0.168167 May 27 09:44:48.781100 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 345/682] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:48 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:48.781443 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-285cc0e6-3c19-43f0-8dbe-46716dfe56a9 req-c1cb38b8-b84d-4132-a111-c9f9c1471d73 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 May 27 09:44:48.782126 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 338/683] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:44:49.798783 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f28b72d4-7f3e-4cc8-9827-187895fdd5ef tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:49.799380 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f28b72d4-7f3e-4cc8-9827-187895fdd5ef tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:49.806227 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f28b72d4-7f3e-4cc8-9827-187895fdd5ef tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:49.806747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f28b72d4-7f3e-4cc8-9827-187895fdd5ef tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:49.807524 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f28b72d4-7f3e-4cc8-9827-187895fdd5ef tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:49.807960 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f28b72d4-7f3e-4cc8-9827-187895fdd5ef tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:49.946983 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f28b72d4-7f3e-4cc8-9827-187895fdd5ef tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:49.956405 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f28b72d4-7f3e-4cc8-9827-187895fdd5ef tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:49.957992 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f28b72d4-7f3e-4cc8-9827-187895fdd5ef tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:49.959206 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f28b72d4-7f3e-4cc8-9827-187895fdd5ef tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1743 microversion: 2.20 time: 0.164799 May 27 09:44:49.959764 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 346/684] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:49 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:50.982018 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1a71d2cb-90b6-42e9-a483-2502b1a5ed92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:50.982787 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1a71d2cb-90b6-42e9-a483-2502b1a5ed92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:50.989703 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a71d2cb-90b6-42e9-a483-2502b1a5ed92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:50.990510 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a71d2cb-90b6-42e9-a483-2502b1a5ed92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:50.991467 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a71d2cb-90b6-42e9-a483-2502b1a5ed92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:50.991904 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a71d2cb-90b6-42e9-a483-2502b1a5ed92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:51.198673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1a71d2cb-90b6-42e9-a483-2502b1a5ed92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:51.212367 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1a71d2cb-90b6-42e9-a483-2502b1a5ed92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:51.214395 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1a71d2cb-90b6-42e9-a483-2502b1a5ed92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:51.217217 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1a71d2cb-90b6-42e9-a483-2502b1a5ed92 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.240030 May 27 09:44:51.226820 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 339/685] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:50 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:52.250473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-eac1c3fb-f324-46ab-b83c-09692cbeffdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:52.251467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-eac1c3fb-f324-46ab-b83c-09692cbeffdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:52.258784 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-eac1c3fb-f324-46ab-b83c-09692cbeffdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:52.259329 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-eac1c3fb-f324-46ab-b83c-09692cbeffdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:52.260117 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-eac1c3fb-f324-46ab-b83c-09692cbeffdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:52.260559 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-eac1c3fb-f324-46ab-b83c-09692cbeffdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:52.427296 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-eac1c3fb-f324-46ab-b83c-09692cbeffdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:52.436040 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-eac1c3fb-f324-46ab-b83c-09692cbeffdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:52.438129 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-eac1c3fb-f324-46ab-b83c-09692cbeffdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:52.439357 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-eac1c3fb-f324-46ab-b83c-09692cbeffdf tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.193384 May 27 09:44:52.439932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 347/686] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:52 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:53.459968 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4f20b414-a2d0-46f1-9514-17c1dee9fd02 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:53.460725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4f20b414-a2d0-46f1-9514-17c1dee9fd02 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:53.468053 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4f20b414-a2d0-46f1-9514-17c1dee9fd02 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:53.468598 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4f20b414-a2d0-46f1-9514-17c1dee9fd02 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:53.469499 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4f20b414-a2d0-46f1-9514-17c1dee9fd02 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:53.470039 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4f20b414-a2d0-46f1-9514-17c1dee9fd02 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:53.625345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4f20b414-a2d0-46f1-9514-17c1dee9fd02 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:53.634934 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4f20b414-a2d0-46f1-9514-17c1dee9fd02 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:53.636182 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4f20b414-a2d0-46f1-9514-17c1dee9fd02 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:53.637769 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4f20b414-a2d0-46f1-9514-17c1dee9fd02 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.181837 May 27 09:44:53.640091 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 340/687] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:53 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:54.660046 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-effe54bc-548b-472e-a81e-f3965fb0567e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:54.660581 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-effe54bc-548b-472e-a81e-f3965fb0567e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:54.671535 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-effe54bc-548b-472e-a81e-f3965fb0567e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:54.671987 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-effe54bc-548b-472e-a81e-f3965fb0567e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:54.683555 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-effe54bc-548b-472e-a81e-f3965fb0567e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:54.684573 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-effe54bc-548b-472e-a81e-f3965fb0567e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:54.872914 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-effe54bc-548b-472e-a81e-f3965fb0567e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:54.883525 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-effe54bc-548b-472e-a81e-f3965fb0567e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:54.886887 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-effe54bc-548b-472e-a81e-f3965fb0567e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:54.889495 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-effe54bc-548b-472e-a81e-f3965fb0567e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.236824 May 27 09:44:54.894283 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 348/688] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:54 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:55.918221 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-05bd0814-353b-4119-8b8e-696eeb71d3eb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:55.920258 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-05bd0814-353b-4119-8b8e-696eeb71d3eb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:55.928939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05bd0814-353b-4119-8b8e-696eeb71d3eb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:55.930342 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05bd0814-353b-4119-8b8e-696eeb71d3eb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:55.932264 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05bd0814-353b-4119-8b8e-696eeb71d3eb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:55.932539 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-05bd0814-353b-4119-8b8e-696eeb71d3eb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:56.128580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-05bd0814-353b-4119-8b8e-696eeb71d3eb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:56.137678 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-05bd0814-353b-4119-8b8e-696eeb71d3eb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:56.139517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-05bd0814-353b-4119-8b8e-696eeb71d3eb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:56.143704 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-05bd0814-353b-4119-8b8e-696eeb71d3eb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.237273 May 27 09:44:56.144226 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 341/689] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:55 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:57.171605 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c5cc7f62-26e4-4ddf-9503-a61faea3e2a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:57.172833 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c5cc7f62-26e4-4ddf-9503-a61faea3e2a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:57.179871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c5cc7f62-26e4-4ddf-9503-a61faea3e2a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:57.182153 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c5cc7f62-26e4-4ddf-9503-a61faea3e2a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:57.193195 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c5cc7f62-26e4-4ddf-9503-a61faea3e2a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:57.194345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c5cc7f62-26e4-4ddf-9503-a61faea3e2a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:57.352278 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c5cc7f62-26e4-4ddf-9503-a61faea3e2a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:57.363835 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c5cc7f62-26e4-4ddf-9503-a61faea3e2a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:57.370434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c5cc7f62-26e4-4ddf-9503-a61faea3e2a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:57.370434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c5cc7f62-26e4-4ddf-9503-a61faea3e2a0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.199441 May 27 09:44:57.370434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 349/690] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:57 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:58.385413 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a31d5c4a-76f6-4422-8fd3-18ee9b65638a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:58.385997 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a31d5c4a-76f6-4422-8fd3-18ee9b65638a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:58.392153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a31d5c4a-76f6-4422-8fd3-18ee9b65638a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:58.392637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a31d5c4a-76f6-4422-8fd3-18ee9b65638a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:58.393390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a31d5c4a-76f6-4422-8fd3-18ee9b65638a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:58.393822 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a31d5c4a-76f6-4422-8fd3-18ee9b65638a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:58.396561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:58.557485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a31d5c4a-76f6-4422-8fd3-18ee9b65638a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:58.576332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a31d5c4a-76f6-4422-8fd3-18ee9b65638a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:58.581707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a31d5c4a-76f6-4422-8fd3-18ee9b65638a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:58.583442 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a31d5c4a-76f6-4422-8fd3-18ee9b65638a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.202052 May 27 09:44:58.583970 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 342/691] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:58 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:44:59.601654 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-bfe7977f-cf34-4a31-b640-58e7518546dc tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:44:59.602814 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-bfe7977f-cf34-4a31-b640-58e7518546dc tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:44:59.610780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bfe7977f-cf34-4a31-b640-58e7518546dc tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:59.611226 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bfe7977f-cf34-4a31-b640-58e7518546dc tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:59.612613 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bfe7977f-cf34-4a31-b640-58e7518546dc tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:44:59.613216 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bfe7977f-cf34-4a31-b640-58e7518546dc tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:44:59.812821 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-bfe7977f-cf34-4a31-b640-58e7518546dc tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:59.819354 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=82 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:44:59.823626 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-bfe7977f-cf34-4a31-b640-58e7518546dc tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:59.825575 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-bfe7977f-cf34-4a31-b640-58e7518546dc tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:44:59.828092 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-bfe7977f-cf34-4a31-b640-58e7518546dc tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.229243 May 27 09:44:59.829237 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 350/692] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:44:59 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:00.848761 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b953e9a5-aa8d-4408-825f-f6d865a061c9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:00.850048 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b953e9a5-aa8d-4408-825f-f6d865a061c9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:00.857449 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=28 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:00.859351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b953e9a5-aa8d-4408-825f-f6d865a061c9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:00.859795 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b953e9a5-aa8d-4408-825f-f6d865a061c9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:00.860575 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b953e9a5-aa8d-4408-825f-f6d865a061c9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:00.861007 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b953e9a5-aa8d-4408-825f-f6d865a061c9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:01.082366 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b953e9a5-aa8d-4408-825f-f6d865a061c9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:01.094089 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b953e9a5-aa8d-4408-825f-f6d865a061c9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:01.096818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b953e9a5-aa8d-4408-825f-f6d865a061c9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:01.098084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b953e9a5-aa8d-4408-825f-f6d865a061c9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.255271 May 27 09:45:01.098731 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 343/693] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:00 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:02.116837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-43727013-87fe-4fe4-84f4-18fc95b5b3db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:02.117435 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-43727013-87fe-4fe4-84f4-18fc95b5b3db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:02.120157 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=28 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:02.125104 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-43727013-87fe-4fe4-84f4-18fc95b5b3db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:02.125543 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-43727013-87fe-4fe4-84f4-18fc95b5b3db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:02.126356 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-43727013-87fe-4fe4-84f4-18fc95b5b3db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:02.126787 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-43727013-87fe-4fe4-84f4-18fc95b5b3db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:02.258386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-43727013-87fe-4fe4-84f4-18fc95b5b3db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:02.267345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-43727013-87fe-4fe4-84f4-18fc95b5b3db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:02.269139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-43727013-87fe-4fe4-84f4-18fc95b5b3db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:02.270343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-43727013-87fe-4fe4-84f4-18fc95b5b3db tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.157431 May 27 09:45:02.270910 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 351/694] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:02 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:03.289074 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-32f33c08-7683-4c6c-b351-5f069c84d452 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:03.289632 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-32f33c08-7683-4c6c-b351-5f069c84d452 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:03.297268 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32f33c08-7683-4c6c-b351-5f069c84d452 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:03.297714 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32f33c08-7683-4c6c-b351-5f069c84d452 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:03.298780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32f33c08-7683-4c6c-b351-5f069c84d452 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:03.299217 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32f33c08-7683-4c6c-b351-5f069c84d452 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:03.434399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-32f33c08-7683-4c6c-b351-5f069c84d452 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:03.442961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-32f33c08-7683-4c6c-b351-5f069c84d452 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:03.449753 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-32f33c08-7683-4c6c-b351-5f069c84d452 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:03.449753 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-32f33c08-7683-4c6c-b351-5f069c84d452 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.160585 May 27 09:45:03.449753 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 344/695] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:03 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:04.464015 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a09b122d-0eee-43d3-ae9e-1b63610dc155 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:04.464659 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a09b122d-0eee-43d3-ae9e-1b63610dc155 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:04.471735 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a09b122d-0eee-43d3-ae9e-1b63610dc155 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:04.472183 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a09b122d-0eee-43d3-ae9e-1b63610dc155 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:04.472941 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a09b122d-0eee-43d3-ae9e-1b63610dc155 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:04.473372 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a09b122d-0eee-43d3-ae9e-1b63610dc155 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:04.604857 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a09b122d-0eee-43d3-ae9e-1b63610dc155 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:04.612085 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a09b122d-0eee-43d3-ae9e-1b63610dc155 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:04.613658 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a09b122d-0eee-43d3-ae9e-1b63610dc155 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:04.614845 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a09b122d-0eee-43d3-ae9e-1b63610dc155 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1738 microversion: 2.20 time: 0.154827 May 27 09:45:04.615545 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 352/696] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:04 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:05.633856 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-84de815a-e9c5-4686-8711-0dd3b191f33f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:05.634538 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-84de815a-e9c5-4686-8711-0dd3b191f33f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:05.641002 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-84de815a-e9c5-4686-8711-0dd3b191f33f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:05.641449 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-84de815a-e9c5-4686-8711-0dd3b191f33f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:05.642221 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-84de815a-e9c5-4686-8711-0dd3b191f33f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:05.642659 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-84de815a-e9c5-4686-8711-0dd3b191f33f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:05.777780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-84de815a-e9c5-4686-8711-0dd3b191f33f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:05.786534 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-84de815a-e9c5-4686-8711-0dd3b191f33f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:05.788037 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-84de815a-e9c5-4686-8711-0dd3b191f33f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:05.789192 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-84de815a-e9c5-4686-8711-0dd3b191f33f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1720 microversion: 2.20 time: 0.159280 May 27 09:45:05.789752 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 345/697] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:05 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:06.768939 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3ea2ec13-57a5-4327-aca1-6463a954ea8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:06.769490 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3ea2ec13-57a5-4327-aca1-6463a954ea8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:06.776728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ea2ec13-57a5-4327-aca1-6463a954ea8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:06.777069 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ea2ec13-57a5-4327-aca1-6463a954ea8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:06.777847 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ea2ec13-57a5-4327-aca1-6463a954ea8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:06.778440 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ea2ec13-57a5-4327-aca1-6463a954ea8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:06.802554 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3ea2ec13-57a5-4327-aca1-6463a954ea8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/ips" status: 200 len: 144 microversion: 2.1 time: 0.037634 May 27 09:45:06.803131 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 353/698] 10.222.0.48 () {58 vars in 1247 bytes} [Fri May 27 09:45:06 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/ips => generated 144 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:06.827796 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6dcc7b97-f165-4a12-a93a-3049bb559147 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:06.827796 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6dcc7b97-f165-4a12-a93a-3049bb559147 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:06.829596 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6dcc7b97-f165-4a12-a93a-3049bb559147 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:06.830138 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6dcc7b97-f165-4a12-a93a-3049bb559147 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:06.830954 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6dcc7b97-f165-4a12-a93a-3049bb559147 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:06.831380 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6dcc7b97-f165-4a12-a93a-3049bb559147 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:06.986841 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6dcc7b97-f165-4a12-a93a-3049bb559147 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:06.995088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6dcc7b97-f165-4a12-a93a-3049bb559147 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:06.996836 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6dcc7b97-f165-4a12-a93a-3049bb559147 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:06.998069 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6dcc7b97-f165-4a12-a93a-3049bb559147 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1720 microversion: 2.20 time: 0.181223 May 27 09:45:06.998700 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 346/699] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:06 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1720 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:08.020577 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-af75ac7a-3411-4a8b-9073-b7c1fd31d925 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:08.021193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-af75ac7a-3411-4a8b-9073-b7c1fd31d925 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:08.028097 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-af75ac7a-3411-4a8b-9073-b7c1fd31d925 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:08.028547 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-af75ac7a-3411-4a8b-9073-b7c1fd31d925 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:08.029326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-af75ac7a-3411-4a8b-9073-b7c1fd31d925 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:08.029760 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-af75ac7a-3411-4a8b-9073-b7c1fd31d925 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:08.162934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-af75ac7a-3411-4a8b-9073-b7c1fd31d925 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:08.171355 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-af75ac7a-3411-4a8b-9073-b7c1fd31d925 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:08.173195 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-af75ac7a-3411-4a8b-9073-b7c1fd31d925 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:08.174412 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-af75ac7a-3411-4a8b-9073-b7c1fd31d925 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1663 microversion: 2.20 time: 0.158379 May 27 09:45:08.184962 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 354/700] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:08 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:08.193037 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0fa6ae97-2575-4657-b77c-de8161b9c57e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feb8f8a4-1e6c-4912-abc9-1caf1d3f90b6"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:08.194137 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0fa6ae97-2575-4657-b77c-de8161b9c57e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:08.200602 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0fa6ae97-2575-4657-b77c-de8161b9c57e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:08.201044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0fa6ae97-2575-4657-b77c-de8161b9c57e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:08.201878 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0fa6ae97-2575-4657-b77c-de8161b9c57e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:08.202454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0fa6ae97-2575-4657-b77c-de8161b9c57e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:08.799259 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-fdf1af73-24d6-42c5-9787-f3337e48ef84 req-9e47874d-08bb-40f7-8b12-611f98e10b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5509199-188d-42fe-9ba4-86939ff60815", "name": "network-vif-unplugged", "status": "completed", "tag": "b4210cbf-916a-49c1-8183-605e8128c6d0"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:08.807221 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-fdf1af73-24d6-42c5-9787-f3337e48ef84 req-9e47874d-08bb-40f7-8b12-611f98e10b25 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:08.807694 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-fdf1af73-24d6-42c5-9787-f3337e48ef84 req-9e47874d-08bb-40f7-8b12-611f98e10b25 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:08.818774 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.compute.server_external_events [req-fdf1af73-24d6-42c5-9787-f3337e48ef84 req-9e47874d-08bb-40f7-8b12-611f98e10b25 service nova] Unable to find a host for instance c5509199-188d-42fe-9ba4-86939ff60815. Dropping event network-vif-unplugged {{(pid=124829) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 09:45:08.819689 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-fdf1af73-24d6-42c5-9787-f3337e48ef84 req-9e47874d-08bb-40f7-8b12-611f98e10b25 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025362 May 27 09:45:08.820325 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 355/701] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 27 09:45:09.630614 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0735556f-a3de-4d72-a4aa-820092dd7dc5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67262ebd-3363-4efa-974b-1ca40ce8b374"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:09.631703 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0735556f-a3de-4d72-a4aa-820092dd7dc5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:09.638356 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0735556f-a3de-4d72-a4aa-820092dd7dc5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:09.638742 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0735556f-a3de-4d72-a4aa-820092dd7dc5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:09.639519 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0735556f-a3de-4d72-a4aa-820092dd7dc5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:09.639952 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0735556f-a3de-4d72-a4aa-820092dd7dc5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:10.009215 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0fa6ae97-2575-4657-b77c-de8161b9c57e tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "POST /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.820108 May 27 09:45:10.023238 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 347/702] 10.222.0.48 () {62 vars in 1363 bytes} [Fri May 27 09:45:08 2022] POST /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/os-volume_attachments => generated 188 bytes in 1822 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 27 09:45:10.133428 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-72dcbe90-bfaa-46d9-a0cc-bec808304888 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:10.133923 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-72dcbe90-bfaa-46d9-a0cc-bec808304888 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:10.140385 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72dcbe90-bfaa-46d9-a0cc-bec808304888 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:10.140829 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72dcbe90-bfaa-46d9-a0cc-bec808304888 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:10.141654 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72dcbe90-bfaa-46d9-a0cc-bec808304888 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:10.142033 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72dcbe90-bfaa-46d9-a0cc-bec808304888 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:11.006847 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0735556f-a3de-4d72-a4aa-820092dd7dc5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.379884 May 27 09:45:11.007529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 356/703] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:45:09 2022] POST /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments => generated 194 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:45:11.516598 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-72dcbe90-bfaa-46d9-a0cc-bec808304888 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/os-volume_attachments/feb8f8a4-1e6c-4912-abc9-1caf1d3f90b6" status: 202 len: 0 microversion: 2.20 time: 1.387000 May 27 09:45:11.517160 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 348/704] 10.222.0.48 () {60 vars in 1456 bytes} [Fri May 27 09:45:10 2022] DELETE /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/os-volume_attachments/feb8f8a4-1e6c-4912-abc9-1caf1d3f90b6 => generated 0 bytes in 1388 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 27 09:45:11.576278 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d8ed9bbe-a3eb-42fd-82c3-2715278605a1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:11.579649 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d8ed9bbe-a3eb-42fd-82c3-2715278605a1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:11.583260 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d8ed9bbe-a3eb-42fd-82c3-2715278605a1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:11.583710 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d8ed9bbe-a3eb-42fd-82c3-2715278605a1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:11.584475 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d8ed9bbe-a3eb-42fd-82c3-2715278605a1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:11.584907 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d8ed9bbe-a3eb-42fd-82c3-2715278605a1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:11.914059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d8ed9bbe-a3eb-42fd-82c3-2715278605a1 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "POST /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/action" status: 202 len: 0 microversion: 2.20 time: 0.342605 May 27 09:45:11.914627 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 357/705] 10.222.0.48 () {62 vars in 1318 bytes} [Fri May 27 09:45:11 2022] POST /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 27 09:45:11.926304 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-06a01dbc-9883-413b-a7d4-3853ebe3a34f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:11.926304 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-06a01dbc-9883-413b-a7d4-3853ebe3a34f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:11.930899 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-06a01dbc-9883-413b-a7d4-3853ebe3a34f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:11.931345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-06a01dbc-9883-413b-a7d4-3853ebe3a34f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:11.932106 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-06a01dbc-9883-413b-a7d4-3853ebe3a34f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:11.932532 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-06a01dbc-9883-413b-a7d4-3853ebe3a34f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:12.071797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-06a01dbc-9883-413b-a7d4-3853ebe3a34f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:12.086277 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-06a01dbc-9883-413b-a7d4-3853ebe3a34f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:12.086277 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-06a01dbc-9883-413b-a7d4-3853ebe3a34f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:12.086277 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-06a01dbc-9883-413b-a7d4-3853ebe3a34f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1671 microversion: 2.20 time: 0.165706 May 27 09:45:12.086612 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 349/706] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:11 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:13.108441 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-69e76e49-4dce-4028-8bf8-25cf6a14fb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:13.109605 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-69e76e49-4dce-4028-8bf8-25cf6a14fb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:13.117827 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-69e76e49-4dce-4028-8bf8-25cf6a14fb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:13.118636 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-69e76e49-4dce-4028-8bf8-25cf6a14fb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:13.123734 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-69e76e49-4dce-4028-8bf8-25cf6a14fb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:13.123734 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-69e76e49-4dce-4028-8bf8-25cf6a14fb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:13.273763 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-69e76e49-4dce-4028-8bf8-25cf6a14fb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:13.288294 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-69e76e49-4dce-4028-8bf8-25cf6a14fb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:13.289889 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-69e76e49-4dce-4028-8bf8-25cf6a14fb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:13.291098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-69e76e49-4dce-4028-8bf8-25cf6a14fb35 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1671 microversion: 2.20 time: 0.188982 May 27 09:45:13.291654 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 358/707] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:13 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1671 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:14.311399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-310b0604-4685-4cd4-94b2-76a57b34f2c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:14.312166 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-310b0604-4685-4cd4-94b2-76a57b34f2c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:14.322325 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-310b0604-4685-4cd4-94b2-76a57b34f2c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:14.323888 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-310b0604-4685-4cd4-94b2-76a57b34f2c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:14.324938 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-310b0604-4685-4cd4-94b2-76a57b34f2c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:14.325126 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-310b0604-4685-4cd4-94b2-76a57b34f2c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:14.631790 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-310b0604-4685-4cd4-94b2-76a57b34f2c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:14.640065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-310b0604-4685-4cd4-94b2-76a57b34f2c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:14.641563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-310b0604-4685-4cd4-94b2-76a57b34f2c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:14.642769 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-310b0604-4685-4cd4-94b2-76a57b34f2c3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1673 microversion: 2.20 time: 0.336292 May 27 09:45:14.643337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 350/708] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:14 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1673 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:45:15.668358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-708e7ccb-438a-43c7-bf98-fba57b0a4bb2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:15.669044 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-708e7ccb-438a-43c7-bf98-fba57b0a4bb2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:15.677058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-708e7ccb-438a-43c7-bf98-fba57b0a4bb2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:15.677550 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-708e7ccb-438a-43c7-bf98-fba57b0a4bb2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:15.678438 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-708e7ccb-438a-43c7-bf98-fba57b0a4bb2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:15.678875 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-708e7ccb-438a-43c7-bf98-fba57b0a4bb2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:15.812988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-708e7ccb-438a-43c7-bf98-fba57b0a4bb2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:15.821494 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-708e7ccb-438a-43c7-bf98-fba57b0a4bb2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:15.823050 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-708e7ccb-438a-43c7-bf98-fba57b0a4bb2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:15.824213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-708e7ccb-438a-43c7-bf98-fba57b0a4bb2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.160179 May 27 09:45:15.824768 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 359/709] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:15 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:45:16.843972 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3ee0693b-c0f7-4e9b-bdaa-c85f63e6618c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:16.845410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3ee0693b-c0f7-4e9b-bdaa-c85f63e6618c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:16.858762 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ee0693b-c0f7-4e9b-bdaa-c85f63e6618c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:16.866225 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ee0693b-c0f7-4e9b-bdaa-c85f63e6618c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:16.866225 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ee0693b-c0f7-4e9b-bdaa-c85f63e6618c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:16.866225 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ee0693b-c0f7-4e9b-bdaa-c85f63e6618c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:17.039015 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3ee0693b-c0f7-4e9b-bdaa-c85f63e6618c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:17.057395 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3ee0693b-c0f7-4e9b-bdaa-c85f63e6618c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:17.059102 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3ee0693b-c0f7-4e9b-bdaa-c85f63e6618c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:17.060308 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3ee0693b-c0f7-4e9b-bdaa-c85f63e6618c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.220595 May 27 09:45:17.061421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 351/710] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:16 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:18.089373 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1a8c3f6d-cdca-43b1-95e3-fab5e54c8d21 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:18.092532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1a8c3f6d-cdca-43b1-95e3-fab5e54c8d21 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:18.100772 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1a8c3f6d-cdca-43b1-95e3-fab5e54c8d21 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:18.101685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1a8c3f6d-cdca-43b1-95e3-fab5e54c8d21 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:18.103011 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1a8c3f6d-cdca-43b1-95e3-fab5e54c8d21 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:18.103641 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1a8c3f6d-cdca-43b1-95e3-fab5e54c8d21 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:18.288250 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1a8c3f6d-cdca-43b1-95e3-fab5e54c8d21 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:18.296768 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1a8c3f6d-cdca-43b1-95e3-fab5e54c8d21 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:18.298545 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1a8c3f6d-cdca-43b1-95e3-fab5e54c8d21 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:18.299729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1a8c3f6d-cdca-43b1-95e3-fab5e54c8d21 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.221147 May 27 09:45:18.300538 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 360/711] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:18 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:19.321150 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9c3435b0-fb9f-473d-95e4-ec9b398c3fbb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:19.325233 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9c3435b0-fb9f-473d-95e4-ec9b398c3fbb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:19.347605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c3435b0-fb9f-473d-95e4-ec9b398c3fbb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:19.348058 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c3435b0-fb9f-473d-95e4-ec9b398c3fbb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:19.358397 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c3435b0-fb9f-473d-95e4-ec9b398c3fbb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:19.358397 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c3435b0-fb9f-473d-95e4-ec9b398c3fbb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:19.578495 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9c3435b0-fb9f-473d-95e4-ec9b398c3fbb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:19.587189 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9c3435b0-fb9f-473d-95e4-ec9b398c3fbb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:19.589134 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9c3435b0-fb9f-473d-95e4-ec9b398c3fbb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:19.590892 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9c3435b0-fb9f-473d-95e4-ec9b398c3fbb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.274128 May 27 09:45:19.604238 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 352/712] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:19 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:20.612232 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5a96b558-d9f8-401c-a575-713ac8b34ae4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:20.612869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5a96b558-d9f8-401c-a575-713ac8b34ae4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:20.619576 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5a96b558-d9f8-401c-a575-713ac8b34ae4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:20.620018 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5a96b558-d9f8-401c-a575-713ac8b34ae4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:20.620829 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5a96b558-d9f8-401c-a575-713ac8b34ae4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:20.621260 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5a96b558-d9f8-401c-a575-713ac8b34ae4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:20.802252 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5a96b558-d9f8-401c-a575-713ac8b34ae4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:20.817467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5a96b558-d9f8-401c-a575-713ac8b34ae4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:20.818113 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5a96b558-d9f8-401c-a575-713ac8b34ae4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:20.819685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5a96b558-d9f8-401c-a575-713ac8b34ae4 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.212040 May 27 09:45:20.820159 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 361/713] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:20 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:21.839334 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c39390da-7de3-43a9-ac14-12902b36058d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:21.839858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c39390da-7de3-43a9-ac14-12902b36058d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:21.847468 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c39390da-7de3-43a9-ac14-12902b36058d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:21.848293 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c39390da-7de3-43a9-ac14-12902b36058d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:21.849441 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c39390da-7de3-43a9-ac14-12902b36058d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:21.850124 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c39390da-7de3-43a9-ac14-12902b36058d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:21.871537 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:22.004416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c39390da-7de3-43a9-ac14-12902b36058d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:22.013237 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c39390da-7de3-43a9-ac14-12902b36058d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:22.015092 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c39390da-7de3-43a9-ac14-12902b36058d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:22.016573 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c39390da-7de3-43a9-ac14-12902b36058d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.181272 May 27 09:45:22.017853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 353/714] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:21 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:23.035813 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9d7054c2-505d-41b0-8fc2-caba707e0f98 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:23.036575 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9d7054c2-505d-41b0-8fc2-caba707e0f98 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:23.043767 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9d7054c2-505d-41b0-8fc2-caba707e0f98 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:23.044219 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9d7054c2-505d-41b0-8fc2-caba707e0f98 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:23.045126 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9d7054c2-505d-41b0-8fc2-caba707e0f98 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:23.045618 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9d7054c2-505d-41b0-8fc2-caba707e0f98 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:23.215956 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9d7054c2-505d-41b0-8fc2-caba707e0f98 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:23.235195 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9d7054c2-505d-41b0-8fc2-caba707e0f98 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:23.236728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9d7054c2-505d-41b0-8fc2-caba707e0f98 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:23.237998 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9d7054c2-505d-41b0-8fc2-caba707e0f98 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.206190 May 27 09:45:23.238647 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 362/715] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:23 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:24.256917 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e17638e5-fdb6-47f9-bf8f-1db1b8e79339 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:24.257983 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e17638e5-fdb6-47f9-bf8f-1db1b8e79339 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:24.267407 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e17638e5-fdb6-47f9-bf8f-1db1b8e79339 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:24.279095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e17638e5-fdb6-47f9-bf8f-1db1b8e79339 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:24.279095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e17638e5-fdb6-47f9-bf8f-1db1b8e79339 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:24.279095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e17638e5-fdb6-47f9-bf8f-1db1b8e79339 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:24.406885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e17638e5-fdb6-47f9-bf8f-1db1b8e79339 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:24.415129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e17638e5-fdb6-47f9-bf8f-1db1b8e79339 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:24.416646 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e17638e5-fdb6-47f9-bf8f-1db1b8e79339 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:24.417824 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e17638e5-fdb6-47f9-bf8f-1db1b8e79339 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.164912 May 27 09:45:24.418429 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 354/716] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:24 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:25.436644 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-847655d4-7025-4a11-85e1-1f74519c20a6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:25.437945 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-847655d4-7025-4a11-85e1-1f74519c20a6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:25.444750 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-847655d4-7025-4a11-85e1-1f74519c20a6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:25.446001 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-847655d4-7025-4a11-85e1-1f74519c20a6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:25.446370 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-847655d4-7025-4a11-85e1-1f74519c20a6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:25.446810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-847655d4-7025-4a11-85e1-1f74519c20a6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:25.756125 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-847655d4-7025-4a11-85e1-1f74519c20a6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:25.765660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-847655d4-7025-4a11-85e1-1f74519c20a6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:25.767017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-847655d4-7025-4a11-85e1-1f74519c20a6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:25.768240 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-847655d4-7025-4a11-85e1-1f74519c20a6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.335815 May 27 09:45:25.768928 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 363/717] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:25 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:26.792793 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-979a73a0-3ae0-4a9b-b843-017c962526d3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:26.793565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-979a73a0-3ae0-4a9b-b843-017c962526d3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:26.802085 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-979a73a0-3ae0-4a9b-b843-017c962526d3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:26.811386 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-979a73a0-3ae0-4a9b-b843-017c962526d3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:26.811386 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-979a73a0-3ae0-4a9b-b843-017c962526d3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:26.811386 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-979a73a0-3ae0-4a9b-b843-017c962526d3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:26.950989 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-979a73a0-3ae0-4a9b-b843-017c962526d3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:26.959986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-979a73a0-3ae0-4a9b-b843-017c962526d3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:26.964333 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-979a73a0-3ae0-4a9b-b843-017c962526d3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:26.964333 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-979a73a0-3ae0-4a9b-b843-017c962526d3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.173818 May 27 09:45:26.964333 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 355/718] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:26 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:27.982386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5ab77cdc-d75e-4413-9806-bbbad533f43c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:27.983655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5ab77cdc-d75e-4413-9806-bbbad533f43c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:27.990564 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5ab77cdc-d75e-4413-9806-bbbad533f43c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:27.991008 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5ab77cdc-d75e-4413-9806-bbbad533f43c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:27.991775 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5ab77cdc-d75e-4413-9806-bbbad533f43c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:27.992395 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5ab77cdc-d75e-4413-9806-bbbad533f43c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:28.148832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5ab77cdc-d75e-4413-9806-bbbad533f43c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:28.157408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5ab77cdc-d75e-4413-9806-bbbad533f43c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:28.158927 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5ab77cdc-d75e-4413-9806-bbbad533f43c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:28.160089 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5ab77cdc-d75e-4413-9806-bbbad533f43c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.181937 May 27 09:45:28.160750 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 364/719] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:27 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:29.179522 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d5fb8bd2-d34d-446c-baf9-836221ce2bb3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:29.180153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d5fb8bd2-d34d-446c-baf9-836221ce2bb3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:29.188065 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5fb8bd2-d34d-446c-baf9-836221ce2bb3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:29.188606 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5fb8bd2-d34d-446c-baf9-836221ce2bb3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:29.189489 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5fb8bd2-d34d-446c-baf9-836221ce2bb3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:29.190008 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5fb8bd2-d34d-446c-baf9-836221ce2bb3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:29.330692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d5fb8bd2-d34d-446c-baf9-836221ce2bb3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:29.338968 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d5fb8bd2-d34d-446c-baf9-836221ce2bb3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:29.340458 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d5fb8bd2-d34d-446c-baf9-836221ce2bb3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:29.341612 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d5fb8bd2-d34d-446c-baf9-836221ce2bb3 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.166038 May 27 09:45:29.342191 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 356/720] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:29 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:30.360749 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9e02d14e-368d-4d4a-a073-bc4e1f98d360 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:30.361357 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9e02d14e-368d-4d4a-a073-bc4e1f98d360 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:30.367996 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9e02d14e-368d-4d4a-a073-bc4e1f98d360 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:30.368438 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9e02d14e-368d-4d4a-a073-bc4e1f98d360 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:30.369196 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9e02d14e-368d-4d4a-a073-bc4e1f98d360 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:30.369632 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9e02d14e-368d-4d4a-a073-bc4e1f98d360 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:30.508690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9e02d14e-368d-4d4a-a073-bc4e1f98d360 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:30.517025 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9e02d14e-368d-4d4a-a073-bc4e1f98d360 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:30.518473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9e02d14e-368d-4d4a-a073-bc4e1f98d360 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:30.519823 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9e02d14e-368d-4d4a-a073-bc4e1f98d360 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.162867 May 27 09:45:30.525057 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 365/721] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:30 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:31.440467 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-182b1cb1-e56c-42d2-9720-9134e6999d36 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:31.441546 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-182b1cb1-e56c-42d2-9720-9134e6999d36 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:31.443914 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=28 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:31.449014 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-182b1cb1-e56c-42d2-9720-9134e6999d36 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:31.449255 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-182b1cb1-e56c-42d2-9720-9134e6999d36 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:31.450031 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-182b1cb1-e56c-42d2-9720-9134e6999d36 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:31.450822 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-182b1cb1-e56c-42d2-9720-9134e6999d36 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:31.482416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-182b1cb1-e56c-42d2-9720-9134e6999d36 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045863 May 27 09:45:31.483249 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 357/722] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:45:31 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:31.494098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c7e3c1b7-60ed-4359-954e-9709b7ca525a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:31.494739 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c7e3c1b7-60ed-4359-954e-9709b7ca525a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:31.501651 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7e3c1b7-60ed-4359-954e-9709b7ca525a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:31.502355 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7e3c1b7-60ed-4359-954e-9709b7ca525a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:31.503202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7e3c1b7-60ed-4359-954e-9709b7ca525a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:31.503712 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c7e3c1b7-60ed-4359-954e-9709b7ca525a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:31.507902 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:31.537772 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c7e3c1b7-60ed-4359-954e-9709b7ca525a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments/67262ebd-3363-4efa-974b-1ca40ce8b374" status: 200 len: 194 microversion: 2.1 time: 0.048455 May 27 09:45:31.538570 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 366/723] 10.222.0.48 () {58 vars in 1412 bytes} [Fri May 27 09:45:31 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments/67262ebd-3363-4efa-974b-1ca40ce8b374 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:45:31.538807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-975cbac7-4e5b-4cb1-9da3-2fd66c059384 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:31.539461 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-975cbac7-4e5b-4cb1-9da3-2fd66c059384 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:31.545872 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-975cbac7-4e5b-4cb1-9da3-2fd66c059384 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:31.546654 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-975cbac7-4e5b-4cb1-9da3-2fd66c059384 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:31.547955 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-975cbac7-4e5b-4cb1-9da3-2fd66c059384 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:31.548638 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-975cbac7-4e5b-4cb1-9da3-2fd66c059384 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:31.691620 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-975cbac7-4e5b-4cb1-9da3-2fd66c059384 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:31.699797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-975cbac7-4e5b-4cb1-9da3-2fd66c059384 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:31.701859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-975cbac7-4e5b-4cb1-9da3-2fd66c059384 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:31.703041 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-975cbac7-4e5b-4cb1-9da3-2fd66c059384 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.169039 May 27 09:45:31.703596 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 358/724] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:31 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 27 09:45:32.722226 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-236a6f44-c36f-4a54-8a1b-9de5fc2a7850 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:32.722886 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-236a6f44-c36f-4a54-8a1b-9de5fc2a7850 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:32.729762 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-236a6f44-c36f-4a54-8a1b-9de5fc2a7850 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:32.730232 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-236a6f44-c36f-4a54-8a1b-9de5fc2a7850 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:32.731014 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-236a6f44-c36f-4a54-8a1b-9de5fc2a7850 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:32.731518 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-236a6f44-c36f-4a54-8a1b-9de5fc2a7850 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:32.888398 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-236a6f44-c36f-4a54-8a1b-9de5fc2a7850 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:32.897335 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-236a6f44-c36f-4a54-8a1b-9de5fc2a7850 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:32.898872 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-236a6f44-c36f-4a54-8a1b-9de5fc2a7850 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:32.900058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-236a6f44-c36f-4a54-8a1b-9de5fc2a7850 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.182216 May 27 09:45:32.900733 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 367/725] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:32 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:32.987381 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-fe7e9605-8343-4130-a178-525add35a57f req-39cc4a8b-c069-4361-ab04-a0c2562308de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5509199-188d-42fe-9ba4-86939ff60815", "name": "network-vif-plugged", "status": "completed", "tag": "b4210cbf-916a-49c1-8183-605e8128c6d0"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:32.997170 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-fe7e9605-8343-4130-a178-525add35a57f req-39cc4a8b-c069-4361-ab04-a0c2562308de service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:32.997622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-fe7e9605-8343-4130-a178-525add35a57f req-39cc4a8b-c069-4361-ab04-a0c2562308de service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:33.010367 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-fe7e9605-8343-4130-a178-525add35a57f req-39cc4a8b-c069-4361-ab04-a0c2562308de service nova] Creating event network-vif-plugged:b4210cbf-916a-49c1-8183-605e8128c6d0 for instance c5509199-188d-42fe-9ba4-86939ff60815 on hv-cinder-82549 May 27 09:45:33.016793 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-fe7e9605-8343-4130-a178-525add35a57f req-39cc4a8b-c069-4361-ab04-a0c2562308de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032982 May 27 09:45:33.017412 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 359/726] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:33.919244 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-195d53e1-3efd-459d-b46c-f21ff2350145 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:33.920536 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-195d53e1-3efd-459d-b46c-f21ff2350145 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:33.928222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-195d53e1-3efd-459d-b46c-f21ff2350145 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:33.928816 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-195d53e1-3efd-459d-b46c-f21ff2350145 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:33.929494 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-195d53e1-3efd-459d-b46c-f21ff2350145 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:33.929934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-195d53e1-3efd-459d-b46c-f21ff2350145 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:34.072523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-195d53e1-3efd-459d-b46c-f21ff2350145 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:34.081158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-195d53e1-3efd-459d-b46c-f21ff2350145 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:34.082681 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-195d53e1-3efd-459d-b46c-f21ff2350145 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:34.083840 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-195d53e1-3efd-459d-b46c-f21ff2350145 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.168625 May 27 09:45:34.084461 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 368/727] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:33 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:34.524719 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d0c41507-3d7e-44e8-b295-4f3db5612f8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaaaa9d4-ab3a-4b87-a0e2-3c7e20f915a7"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:34.525931 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d0c41507-3d7e-44e8-b295-4f3db5612f8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:34.532434 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d0c41507-3d7e-44e8-b295-4f3db5612f8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:34.532883 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d0c41507-3d7e-44e8-b295-4f3db5612f8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:34.533655 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d0c41507-3d7e-44e8-b295-4f3db5612f8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:34.534092 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d0c41507-3d7e-44e8-b295-4f3db5612f8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:35.103555 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-38223d17-f20e-4f93-8d4c-e084b9d083b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:35.104259 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-38223d17-f20e-4f93-8d4c-e084b9d083b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:35.106916 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=38 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:35.112322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-38223d17-f20e-4f93-8d4c-e084b9d083b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:35.113565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-38223d17-f20e-4f93-8d4c-e084b9d083b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:35.114679 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-38223d17-f20e-4f93-8d4c-e084b9d083b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:35.115321 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-38223d17-f20e-4f93-8d4c-e084b9d083b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:35.266227 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-38223d17-f20e-4f93-8d4c-e084b9d083b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:35.270459 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-38223d17-f20e-4f93-8d4c-e084b9d083b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:35.272005 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-38223d17-f20e-4f93-8d4c-e084b9d083b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:35.273447 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-38223d17-f20e-4f93-8d4c-e084b9d083b6 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.174122 May 27 09:45:35.273877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 369/728] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:35 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:35.784170 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d0c41507-3d7e-44e8-b295-4f3db5612f8b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "POST /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.264043 May 27 09:45:35.785043 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 360/729] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:45:34 2022] POST /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments => generated 194 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:36.292728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-18bfccb2-2c68-4bb3-831d-dc2ba679785f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:36.293434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-18bfccb2-2c68-4bb3-831d-dc2ba679785f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:36.301931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-18bfccb2-2c68-4bb3-831d-dc2ba679785f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:36.302506 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-18bfccb2-2c68-4bb3-831d-dc2ba679785f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:36.303311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-18bfccb2-2c68-4bb3-831d-dc2ba679785f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:36.303751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-18bfccb2-2c68-4bb3-831d-dc2ba679785f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:36.447872 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-18bfccb2-2c68-4bb3-831d-dc2ba679785f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:36.456752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-18bfccb2-2c68-4bb3-831d-dc2ba679785f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:36.458429 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-18bfccb2-2c68-4bb3-831d-dc2ba679785f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:36.459632 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-18bfccb2-2c68-4bb3-831d-dc2ba679785f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1729 microversion: 2.20 time: 0.171317 May 27 09:45:36.460553 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 370/730] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:36 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:37.479321 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-68e4334d-dc61-4510-9782-f62637b2544d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:37.480021 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-68e4334d-dc61-4510-9782-f62637b2544d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:37.487614 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-68e4334d-dc61-4510-9782-f62637b2544d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:37.488060 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-68e4334d-dc61-4510-9782-f62637b2544d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:37.488825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-68e4334d-dc61-4510-9782-f62637b2544d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:37.489254 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-68e4334d-dc61-4510-9782-f62637b2544d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:37.629522 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-68e4334d-dc61-4510-9782-f62637b2544d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:37.638131 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-68e4334d-dc61-4510-9782-f62637b2544d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:37.639659 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-68e4334d-dc61-4510-9782-f62637b2544d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:37.640846 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-68e4334d-dc61-4510-9782-f62637b2544d tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1716 microversion: 2.20 time: 0.165952 May 27 09:45:37.641408 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 361/731] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:45:37 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:45:44.381860 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1c494424-9d5c-4eb7-9739-26f8353509cd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:44.383062 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1c494424-9d5c-4eb7-9739-26f8353509cd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:44.400321 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1c494424-9d5c-4eb7-9739-26f8353509cd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:44.400775 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1c494424-9d5c-4eb7-9739-26f8353509cd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:44.401574 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1c494424-9d5c-4eb7-9739-26f8353509cd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:44.402018 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1c494424-9d5c-4eb7-9739-26f8353509cd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:44.436216 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1c494424-9d5c-4eb7-9739-26f8353509cd tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.057898 May 27 09:45:44.436655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 371/732] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:45:44 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments => generated 371 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:44.577721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f84a84b3-6931-4848-8059-9ca1e27fa866 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:44.578367 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f84a84b3-6931-4848-8059-9ca1e27fa866 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:44.585305 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f84a84b3-6931-4848-8059-9ca1e27fa866 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:44.585833 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f84a84b3-6931-4848-8059-9ca1e27fa866 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:44.586712 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f84a84b3-6931-4848-8059-9ca1e27fa866 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:44.587219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f84a84b3-6931-4848-8059-9ca1e27fa866 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:44.617673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f84a84b3-6931-4848-8059-9ca1e27fa866 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments/67262ebd-3363-4efa-974b-1ca40ce8b374" status: 200 len: 194 microversion: 2.1 time: 0.044585 May 27 09:45:44.618419 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 362/733] 10.222.0.48 () {58 vars in 1412 bytes} [Fri May 27 09:45:44 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments/67262ebd-3363-4efa-974b-1ca40ce8b374 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:44.628575 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b52398d2-0837-4ef0-8e94-065407ceaa58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:44.629177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b52398d2-0837-4ef0-8e94-065407ceaa58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:44.635310 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b52398d2-0837-4ef0-8e94-065407ceaa58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:44.635843 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b52398d2-0837-4ef0-8e94-065407ceaa58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:44.636679 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b52398d2-0837-4ef0-8e94-065407ceaa58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:44.637123 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b52398d2-0837-4ef0-8e94-065407ceaa58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:44.719849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-b52398d2-0837-4ef0-8e94-065407ceaa58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lazy-loading 'services' on Instance uuid 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:45:45.099879 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b52398d2-0837-4ef0-8e94-065407ceaa58 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments/67262ebd-3363-4efa-974b-1ca40ce8b374" status: 202 len: 0 microversion: 2.1 time: 0.474993 May 27 09:45:45.100475 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 372/734] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:45:44 2022] DELETE /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments/67262ebd-3363-4efa-974b-1ca40ce8b374 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:45:46.430695 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7453e329-7b5f-4016-8a1e-a9b479c6b9cf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:46.431315 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7453e329-7b5f-4016-8a1e-a9b479c6b9cf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:46.437894 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7453e329-7b5f-4016-8a1e-a9b479c6b9cf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:46.438393 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7453e329-7b5f-4016-8a1e-a9b479c6b9cf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:46.439167 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7453e329-7b5f-4016-8a1e-a9b479c6b9cf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:46.439638 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7453e329-7b5f-4016-8a1e-a9b479c6b9cf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:46.473133 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7453e329-7b5f-4016-8a1e-a9b479c6b9cf tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments/aaaaa9d4-ab3a-4b87-a0e2-3c7e20f915a7" status: 200 len: 194 microversion: 2.1 time: 0.046369 May 27 09:45:46.473742 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 363/735] 10.222.0.48 () {58 vars in 1412 bytes} [Fri May 27 09:45:46 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments/aaaaa9d4-ab3a-4b87-a0e2-3c7e20f915a7 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:46.484754 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4ecf11d5-9268-464b-b53c-6e89c3cb69e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:46.485427 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4ecf11d5-9268-464b-b53c-6e89c3cb69e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:46.492106 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ecf11d5-9268-464b-b53c-6e89c3cb69e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:46.492577 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ecf11d5-9268-464b-b53c-6e89c3cb69e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:46.493329 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ecf11d5-9268-464b-b53c-6e89c3cb69e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:46.493768 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ecf11d5-9268-464b-b53c-6e89c3cb69e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:46.594598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-4ecf11d5-9268-464b-b53c-6e89c3cb69e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lazy-loading 'services' on Instance uuid 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:45:46.903091 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4ecf11d5-9268-464b-b53c-6e89c3cb69e2 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments/aaaaa9d4-ab3a-4b87-a0e2-3c7e20f915a7" status: 202 len: 0 microversion: 2.1 time: 0.422501 May 27 09:45:46.906934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 373/736] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:45:46 2022] DELETE /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments/aaaaa9d4-ab3a-4b87-a0e2-3c7e20f915a7 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:45:47.752988 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-19028320", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "networks": [{"uuid": "de0d4211-2d49-40de-aa12-f8cd932f5969"}]}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:47.811617 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] validate_networks() for [('de0d4211-2d49-40de-aa12-f8cd932f5969', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:45:48.093091 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-27f4d22c-49a3-49ed-ad23-2dc845766fa5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:48.094363 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-27f4d22c-49a3-49ed-ad23-2dc845766fa5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:48.101404 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-27f4d22c-49a3-49ed-ad23-2dc845766fa5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:48.101853 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-27f4d22c-49a3-49ed-ad23-2dc845766fa5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:48.103519 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-27f4d22c-49a3-49ed-ad23-2dc845766fa5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:48.103519 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-27f4d22c-49a3-49ed-ad23-2dc845766fa5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:48.141916 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-27f4d22c-49a3-49ed-ad23-2dc845766fa5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056463 May 27 09:45:48.142550 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 374/737] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:45:48 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:45:48.277375 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d72868ac-69b3-4b57-bf67-b1ce03d427e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:48.278382 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d72868ac-69b3-4b57-bf67-b1ce03d427e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:48.285704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d72868ac-69b3-4b57-bf67-b1ce03d427e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:48.286150 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d72868ac-69b3-4b57-bf67-b1ce03d427e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:48.286987 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d72868ac-69b3-4b57-bf67-b1ce03d427e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:48.287426 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d72868ac-69b3-4b57-bf67-b1ce03d427e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:48.335358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d72868ac-69b3-4b57-bf67-b1ce03d427e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061605 May 27 09:45:48.336421 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 375/738] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:45:48 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 27 09:45:48.410697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-92e1a3e9-8f38-4605-ac34-15bb861d7ea7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:48.411264 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-92e1a3e9-8f38-4605-ac34-15bb861d7ea7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:48.418067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-92e1a3e9-8f38-4605-ac34-15bb861d7ea7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:48.418602 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-92e1a3e9-8f38-4605-ac34-15bb861d7ea7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:48.419421 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-92e1a3e9-8f38-4605-ac34-15bb861d7ea7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:48.420438 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-92e1a3e9-8f38-4605-ac34-15bb861d7ea7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:48.450981 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-92e1a3e9-8f38-4605-ac34-15bb861d7ea7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:45:48.500883 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:45:48.501468 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:45:48.501800 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:45:48.502184 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:45:48.502616 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:45:48.512691 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:48.513178 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:48.513981 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:48.514457 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:48.532042 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Getting quotas for project 1c6cf7096e63465d8e861f9f82b21e2b. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:45:48.536354 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Getting quotas for user 09e3e81754b345009e5d2b976ca321f4 and project 1c6cf7096e63465d8e861f9f82b21e2b. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:45:48.548997 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:45:48.551405 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:45:48.777275 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-19a1cfe1-e2ff-49a7-8556-958c004452de tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028150 May 27 09:45:48.778329 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 364/739] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:45:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1030 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:45:48.789369 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-184c1a4c-f673-4827-99f8-9991691d2967 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:48.790002 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-184c1a4c-f673-4827-99f8-9991691d2967 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:48.845328 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-184c1a4c-f673-4827-99f8-9991691d2967 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:48.852132 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-184c1a4c-f673-4827-99f8-9991691d2967 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1217 microversion: 2.1 time: 0.067193 May 27 09:45:48.852717 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 365/740] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:48 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:45:48.982860 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-92e1a3e9-8f38-4605-ac34-15bb861d7ea7 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 204 len: 0 microversion: 2.1 time: 0.576203 May 27 09:45:48.983442 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 376/741] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:45:48 2022] DELETE /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 09:45:48.991624 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7713503e-61d6-4283-8dc6-1f1221b942f1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:48.992260 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7713503e-61d6-4283-8dc6-1f1221b942f1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:49.000257 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7713503e-61d6-4283-8dc6-1f1221b942f1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:49.000723 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7713503e-61d6-4283-8dc6-1f1221b942f1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:49.001535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7713503e-61d6-4283-8dc6-1f1221b942f1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:49.002019 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7713503e-61d6-4283-8dc6-1f1221b942f1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:49.137141 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7713503e-61d6-4283-8dc6-1f1221b942f1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:49.145634 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7713503e-61d6-4283-8dc6-1f1221b942f1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1671 microversion: 2.1 time: 0.157772 May 27 09:45:49.146258 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 366/742] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:48 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:49.869320 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-83c300e5-81d6-4e84-9068-d9080f1f09ad tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:49.870024 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-83c300e5-81d6-4e84-9068-d9080f1f09ad tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:49.926592 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-83c300e5-81d6-4e84-9068-d9080f1f09ad tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:49.933934 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-83c300e5-81d6-4e84-9068-d9080f1f09ad tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1217 microversion: 2.1 time: 0.068856 May 27 09:45:49.934516 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 377/743] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:49 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:50.163456 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-cbdd2cb7-08b8-4394-b960-78edb8297756 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:50.163980 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-cbdd2cb7-08b8-4394-b960-78edb8297756 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:50.173779 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cbdd2cb7-08b8-4394-b960-78edb8297756 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:50.174258 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cbdd2cb7-08b8-4394-b960-78edb8297756 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:50.175050 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cbdd2cb7-08b8-4394-b960-78edb8297756 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:50.175490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-cbdd2cb7-08b8-4394-b960-78edb8297756 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:50.309973 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-cbdd2cb7-08b8-4394-b960-78edb8297756 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:50.318173 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-cbdd2cb7-08b8-4394-b960-78edb8297756 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1671 microversion: 2.1 time: 0.158688 May 27 09:45:50.318758 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 367/744] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:50 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:45:50.956895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d5cf8403-8226-45c8-934c-dcc9ea0d02ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:50.956895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d5cf8403-8226-45c8-934c-dcc9ea0d02ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:51.007988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d5cf8403-8226-45c8-934c-dcc9ea0d02ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:51.015410 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d5cf8403-8226-45c8-934c-dcc9ea0d02ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1217 microversion: 2.1 time: 0.068403 May 27 09:45:51.015966 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 378/745] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:50 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:51.337648 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-99e0d31b-1c0d-4a0a-b52d-2c6dcf78e858 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:51.338368 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-99e0d31b-1c0d-4a0a-b52d-2c6dcf78e858 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:51.345444 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-99e0d31b-1c0d-4a0a-b52d-2c6dcf78e858 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:51.345778 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-99e0d31b-1c0d-4a0a-b52d-2c6dcf78e858 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:51.346590 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-99e0d31b-1c0d-4a0a-b52d-2c6dcf78e858 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:51.347023 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-99e0d31b-1c0d-4a0a-b52d-2c6dcf78e858 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:51.482721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-99e0d31b-1c0d-4a0a-b52d-2c6dcf78e858 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:51.490322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-99e0d31b-1c0d-4a0a-b52d-2c6dcf78e858 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1671 microversion: 2.1 time: 0.156607 May 27 09:45:51.490913 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 368/746] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:51 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:52.032921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-633fdc3b-7c17-4f79-aecd-cb4c14370fe2 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:52.033940 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-633fdc3b-7c17-4f79-aecd-cb4c14370fe2 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:52.126609 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-633fdc3b-7c17-4f79-aecd-cb4c14370fe2 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:52.136424 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-633fdc3b-7c17-4f79-aecd-cb4c14370fe2 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1217 microversion: 2.1 time: 0.107897 May 27 09:45:52.137016 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 379/747] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:52 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1217 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:52.148487 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-cdb7536a-3997-444c-a426-1ee5d273092e req-a5abab91-bcc7-402e-841d-afa4f037bdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858596a7-d1e4-4c2f-a1fd-f5c46f9dd974", "name": "network-vif-deleted", "tag": "e0f16fa2-bfdd-4cee-ba09-8f3e12eb87f2"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:52.160733 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-cdb7536a-3997-444c-a426-1ee5d273092e req-a5abab91-bcc7-402e-841d-afa4f037bdc7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:52.161692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-cdb7536a-3997-444c-a426-1ee5d273092e req-a5abab91-bcc7-402e-841d-afa4f037bdc7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:52.175501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-cdb7536a-3997-444c-a426-1ee5d273092e req-a5abab91-bcc7-402e-841d-afa4f037bdc7 service nova] Creating event network-vif-deleted:e0f16fa2-bfdd-4cee-ba09-8f3e12eb87f2 for instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 on hv-cinder-82549 May 27 09:45:52.188348 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-cdb7536a-3997-444c-a426-1ee5d273092e req-a5abab91-bcc7-402e-841d-afa4f037bdc7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052519 May 27 09:45:52.191133 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 369/748] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:52.508747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:52.509739 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:52.516178 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:52.516838 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:52.517796 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:52.518248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:52.551182 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:52.551631 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:52.552081 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lazy-loading 'fault' on Instance uuid 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:45:52.594405 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e5081aed86004f6c99a05c9fbf2a36b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64c171ba5fcb489d911aeb8c5abf4bb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:52.602102 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-75aa6e9c-1ec0-483e-8610-b7fb38ffa8a1 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 200 len: 1327 microversion: 2.1 time: 0.097474 May 27 09:45:52.602991 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 380/749] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:52 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 1327 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:45:53.155932 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2c72ea28-615c-44f7-916c-79dae4a27448 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:53.156522 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2c72ea28-615c-44f7-916c-79dae4a27448 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:53.163670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c72ea28-615c-44f7-916c-79dae4a27448 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:53.164149 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c72ea28-615c-44f7-916c-79dae4a27448 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:53.164993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c72ea28-615c-44f7-916c-79dae4a27448 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:53.165967 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c72ea28-615c-44f7-916c-79dae4a27448 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:53.238761 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2c72ea28-615c-44f7-916c-79dae4a27448 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:53.246729 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2c72ea28-615c-44f7-916c-79dae4a27448 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1221 microversion: 2.1 time: 0.096322 May 27 09:45:53.247313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 370/750] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:53 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1221 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:53.623029 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4ef29483-88b5-4972-b6b4-a9669153e90b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:53.623639 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4ef29483-88b5-4972-b6b4-a9669153e90b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:53.630470 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ef29483-88b5-4972-b6b4-a9669153e90b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:53.630924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ef29483-88b5-4972-b6b4-a9669153e90b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:53.631699 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ef29483-88b5-4972-b6b4-a9669153e90b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:53.632247 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ef29483-88b5-4972-b6b4-a9669153e90b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:53.645822 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-4ef29483-88b5-4972-b6b4-a9669153e90b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] HTTP exception thrown: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4ef29483-88b5-4972-b6b4-a9669153e90b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Request method failure captured: May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 HTTP/1.1 May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuia6YFrK2Odk74OfWALKtT0Zt08Eb8K4pP0ol5D71Y17mP1TTqNM-WNzrgE8uV7PXGPerOAFkbmv53uV2nrh3hJ1w7-D7XuPhNcghNueFiXCk699Yh3fZl6bJOVqsfFMvNVhFucf6LYU5ptXfLxAnmk4IBPjrX0it1gtm8FSMHXBY May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:45:53.647499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_64c171ba5fcb489d911aeb8c5abf4bb2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: e5081aed86004f6c99a05c9fbf2a36b9 May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:53.649017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '858596a7-d1e4-4c2f-a1fd-f5c46f9dd974'} May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:45:53.649895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:53.651390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:53.652754 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4ef29483-88b5-4972-b6b4-a9669153e90b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Returning 404 to user: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:45:53.652754 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4ef29483-88b5-4972-b6b4-a9669153e90b tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 404 len: 111 microversion: 2.1 time: 0.029795 May 27 09:45:53.652754 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 381/751] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:53 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:45:53.658998 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a04e677d-6909-410a-b094-da4f05fd10b0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '.version_select at 0x7fbe3236e160>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:53.955219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a04e677d-6909-410a-b094-da4f05fd10b0 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-240591320" status: 202 len: 0 microversion: 2.1 time: 0.301027 May 27 09:45:53.955802 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 371/752] 10.222.0.48 () {58 vars in 1217 bytes} [Fri May 27 09:45:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-240591320 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:45:54.265469 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9eaab677-4dc2-4aac-b9c1-17e189ff5fb5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:54.323680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9eaab677-4dc2-4aac-b9c1-17e189ff5fb5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:54.323680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9eaab677-4dc2-4aac-b9c1-17e189ff5fb5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:54.323680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9eaab677-4dc2-4aac-b9c1-17e189ff5fb5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:54.323680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9eaab677-4dc2-4aac-b9c1-17e189ff5fb5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:54.324098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9eaab677-4dc2-4aac-b9c1-17e189ff5fb5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:54.341653 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9eaab677-4dc2-4aac-b9c1-17e189ff5fb5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:54.349917 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9eaab677-4dc2-4aac-b9c1-17e189ff5fb5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1221 microversion: 2.1 time: 0.088980 May 27 09:45:54.350517 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 382/753] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:54 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1221 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:55.367346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2392f3e9-4a5a-4e2c-bf52-f00cca8912db tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:55.367996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2392f3e9-4a5a-4e2c-bf52-f00cca8912db tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:55.373946 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2392f3e9-4a5a-4e2c-bf52-f00cca8912db tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:55.374446 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2392f3e9-4a5a-4e2c-bf52-f00cca8912db tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:55.375212 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2392f3e9-4a5a-4e2c-bf52-f00cca8912db tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:55.375649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2392f3e9-4a5a-4e2c-bf52-f00cca8912db tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:55.444952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2392f3e9-4a5a-4e2c-bf52-f00cca8912db tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:55.448807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:55.453670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2392f3e9-4a5a-4e2c-bf52-f00cca8912db tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1213 microversion: 2.1 time: 0.090707 May 27 09:45:55.454284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 372/754] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:55 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:56.472145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f24c0997-a1e4-41d2-afd4-3650a9a2e109 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:56.472822 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f24c0997-a1e4-41d2-afd4-3650a9a2e109 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:56.479481 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f24c0997-a1e4-41d2-afd4-3650a9a2e109 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:56.479936 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f24c0997-a1e4-41d2-afd4-3650a9a2e109 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:56.480710 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f24c0997-a1e4-41d2-afd4-3650a9a2e109 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:56.481149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f24c0997-a1e4-41d2-afd4-3650a9a2e109 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:56.486105 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:56.568844 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f24c0997-a1e4-41d2-afd4-3650a9a2e109 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:56.576985 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f24c0997-a1e4-41d2-afd4-3650a9a2e109 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1277 microversion: 2.1 time: 0.108822 May 27 09:45:56.577560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 383/755] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:56 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:57.594556 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-721e5d11-bc25-4e94-935d-593c19541ff3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:57.595167 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-721e5d11-bc25-4e94-935d-593c19541ff3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:57.602353 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-721e5d11-bc25-4e94-935d-593c19541ff3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:57.602733 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-721e5d11-bc25-4e94-935d-593c19541ff3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:57.603494 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-721e5d11-bc25-4e94-935d-593c19541ff3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:57.603934 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-721e5d11-bc25-4e94-935d-593c19541ff3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:57.740805 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-721e5d11-bc25-4e94-935d-593c19541ff3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:57.749184 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-721e5d11-bc25-4e94-935d-593c19541ff3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1317 microversion: 2.1 time: 0.158431 May 27 09:45:57.749782 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 373/756] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:57 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:45:58.401761 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d7e81c4b-e186-4525-b8bb-a82ed8b9196a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:58.402287 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d7e81c4b-e186-4525-b8bb-a82ed8b9196a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:58.410694 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d7e81c4b-e186-4525-b8bb-a82ed8b9196a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:58.411187 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d7e81c4b-e186-4525-b8bb-a82ed8b9196a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:58.412016 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d7e81c4b-e186-4525-b8bb-a82ed8b9196a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:58.412809 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d7e81c4b-e186-4525-b8bb-a82ed8b9196a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:58.427259 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-d7e81c4b-e186-4525-b8bb-a82ed8b9196a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] HTTP exception thrown: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d7e81c4b-e186-4525-b8bb-a82ed8b9196a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Request method failure captured: May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 HTTP/1.1 May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuia6YFrK2Odk74OfWALKtT0Zt08Eb8K4pP0ol5D71Y17mP1TTqNM-WNzrgE8uV7PXGPerOAFkbmv53uV2nrh3hJ1w7-D7XuPhNcghNueFiXCk699Yh3fZl6bJOVqsfFMvNVhFucf6LYU5ptXfLxAnmk4IBPjrX0it1gtm8FSMHXBY May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:45:58.429139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_64c171ba5fcb489d911aeb8c5abf4bb2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: e5081aed86004f6c99a05c9fbf2a36b9 May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:58.430808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '858596a7-d1e4-4c2f-a1fd-f5c46f9dd974'} May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:45:58.431729 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:58.433275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:58.435787 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d7e81c4b-e186-4525-b8bb-a82ed8b9196a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Returning 404 to user: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:45:58.435787 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d7e81c4b-e186-4525-b8bb-a82ed8b9196a tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 404 len: 111 microversion: 2.1 time: 0.032626 May 27 09:45:58.435787 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 384/757] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:45:58 2022] DELETE /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:45:58.442463 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9a014e77-51ba-42ce-a470-7371e0492c70 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:58.443110 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9a014e77-51ba-42ce-a470-7371e0492c70 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:58.449788 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a014e77-51ba-42ce-a470-7371e0492c70 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:58.450263 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a014e77-51ba-42ce-a470-7371e0492c70 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:58.451597 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a014e77-51ba-42ce-a470-7371e0492c70 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:58.452034 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a014e77-51ba-42ce-a470-7371e0492c70 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:58.466169 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-9a014e77-51ba-42ce-a470-7371e0492c70 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] HTTP exception thrown: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9a014e77-51ba-42ce-a470-7371e0492c70 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Request method failure captured: May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 HTTP/1.1 May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuia6YFrK2Odk74OfWALKtT0Zt08Eb8K4pP0ol5D71Y17mP1TTqNM-WNzrgE8uV7PXGPerOAFkbmv53uV2nrh3hJ1w7-D7XuPhNcghNueFiXCk699Yh3fZl6bJOVqsfFMvNVhFucf6LYU5ptXfLxAnmk4IBPjrX0it1gtm8FSMHXBY May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:45:58.468547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_64c171ba5fcb489d911aeb8c5abf4bb2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: e5081aed86004f6c99a05c9fbf2a36b9 May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:58.470009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '858596a7-d1e4-4c2f-a1fd-f5c46f9dd974'} May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:45:58.470939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. May 27 09:45:58.472721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:45:58.474071 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9a014e77-51ba-42ce-a470-7371e0492c70 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Returning 404 to user: Instance 858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:45:58.474071 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9a014e77-51ba-42ce-a470-7371e0492c70 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974" status: 404 len: 111 microversion: 2.1 time: 0.031518 May 27 09:45:58.474071 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 374/758] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:58 2022] GET /compute/v2.1/servers/858596a7-d1e4-4c2f-a1fd-f5c46f9dd974 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:45:58.656242 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-e0262041-88fa-476b-a79b-4edc8ade6e9a req-d280fd99-e09c-45d2-90bb-1c252278d1bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e594966b-9aeb-4686-99df-3bff0a8f1c92", "tag": "78434af1-6c26-4b3b-a4b3-775e641ef393"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:45:58.665198 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-e0262041-88fa-476b-a79b-4edc8ade6e9a req-d280fd99-e09c-45d2-90bb-1c252278d1bf service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:58.665787 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-e0262041-88fa-476b-a79b-4edc8ade6e9a req-d280fd99-e09c-45d2-90bb-1c252278d1bf service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:58.679947 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-e0262041-88fa-476b-a79b-4edc8ade6e9a req-d280fd99-e09c-45d2-90bb-1c252278d1bf service nova] Creating event network-changed:78434af1-6c26-4b3b-a4b3-775e641ef393 for instance e594966b-9aeb-4686-99df-3bff0a8f1c92 on hv-cinder-82549 May 27 09:45:58.685706 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-e0262041-88fa-476b-a79b-4edc8ade6e9a req-d280fd99-e09c-45d2-90bb-1c252278d1bf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033676 May 27 09:45:58.686315 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 385/759] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:45:58.768730 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3e32fa7f-ff62-4464-ab68-feab5a93f860 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:58.769370 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3e32fa7f-ff62-4464-ab68-feab5a93f860 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:58.771650 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:58.778329 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3e32fa7f-ff62-4464-ab68-feab5a93f860 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:58.778964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3e32fa7f-ff62-4464-ab68-feab5a93f860 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:58.780082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3e32fa7f-ff62-4464-ab68-feab5a93f860 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:58.780540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3e32fa7f-ff62-4464-ab68-feab5a93f860 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:58.850098 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=8 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:45:58.920329 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3e32fa7f-ff62-4464-ab68-feab5a93f860 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:45:58.927035 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3e32fa7f-ff62-4464-ab68-feab5a93f860 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1317 microversion: 2.1 time: 0.162279 May 27 09:45:58.927602 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 375/760] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:58 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:45:59.874060 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ae30c0ca-b163-412a-815b-92d69e28d6e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:59.874709 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ae30c0ca-b163-412a-815b-92d69e28d6e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:59.881643 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ae30c0ca-b163-412a-815b-92d69e28d6e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:59.882083 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ae30c0ca-b163-412a-815b-92d69e28d6e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:59.882883 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ae30c0ca-b163-412a-815b-92d69e28d6e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:59.883314 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ae30c0ca-b163-412a-815b-92d69e28d6e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:59.898277 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-ae30c0ca-b163-412a-815b-92d69e28d6e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] HTTP exception thrown: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ae30c0ca-b163-412a-815b-92d69e28d6e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Request method failure captured: May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 HTTP/1.1 May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuia6YFrK2Odk74OfWALKtT0Zt08Eb8K4pP0ol5D71Y17mP1TTqNM-WNzrgE8uV7PXGPerOAFkbmv53uV2nrh3hJ1w7-D7XuPhNcghNueFiXCk699Yh3fZl6bJOVqsfFMvNVhFucf6LYU5ptXfLxAnmk4IBPjrX0it1gtm8FSMHXBY May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:45:59.899849 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_64c171ba5fcb489d911aeb8c5abf4bb2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: e5081aed86004f6c99a05c9fbf2a36b9 May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:45:59.901444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '8b5ab4e3-6570-4604-b7fb-7592f7bb0d41'} May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:45:59.902255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:45:59.903625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:45:59.905591 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ae30c0ca-b163-412a-815b-92d69e28d6e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Returning 404 to user: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:45:59.905591 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ae30c0ca-b163-412a-815b-92d69e28d6e6 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 404 len: 111 microversion: 2.1 time: 0.031761 May 27 09:45:59.905591 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 386/761] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:45:59 2022] DELETE /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:45:59.910964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-db39f643-b7e0-4027-b41a-fbaa74d599b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:59.911567 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-db39f643-b7e0-4027-b41a-fbaa74d599b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] [instance: 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:59.918571 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-db39f643-b7e0-4027-b41a-fbaa74d599b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:59.919016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-db39f643-b7e0-4027-b41a-fbaa74d599b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:59.919827 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-db39f643-b7e0-4027-b41a-fbaa74d599b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:59.920259 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-db39f643-b7e0-4027-b41a-fbaa74d599b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:59.934303 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-db39f643-b7e0-4027-b41a-fbaa74d599b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] HTTP exception thrown: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-db39f643-b7e0-4027-b41a-fbaa74d599b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Request method failure captured: May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 HTTP/1.1 May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuia6YFrK2Odk74OfWALKtT0Zt08Eb8K4pP0ol5D71Y17mP1TTqNM-WNzrgE8uV7PXGPerOAFkbmv53uV2nrh3hJ1w7-D7XuPhNcghNueFiXCk699Yh3fZl6bJOVqsfFMvNVhFucf6LYU5ptXfLxAnmk4IBPjrX0it1gtm8FSMHXBY May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:45:59.935986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/64c171ba5fcb489d911aeb8c5abf4bb2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_64c171ba5fcb489d911aeb8c5abf4bb2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 64c171ba5fcb489d911aeb8c5abf4bb2 May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1295942379 May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: e5081aed86004f6c99a05c9fbf2a36b9 May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-AttachVolumeTestJSON-1295942379-project May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:45:59.937756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '8b5ab4e3-6570-4604-b7fb-7592f7bb0d41'} May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:45:59.938565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. May 27 09:45:59.939707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:45:59.940753 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-db39f643-b7e0-4027-b41a-fbaa74d599b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] Returning 404 to user: Instance 8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:45:59.940753 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-db39f643-b7e0-4027-b41a-fbaa74d599b5 tempest-AttachVolumeTestJSON-1295942379 tempest-AttachVolumeTestJSON-1295942379-project] 10.222.0.48 "GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41" status: 404 len: 111 microversion: 2.1 time: 0.030901 May 27 09:45:59.940753 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 376/762] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:59 2022] GET /compute/v2.1/servers/8b5ab4e3-6570-4604-b7fb-7592f7bb0d41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 09:45:59.947427 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a55a9a8c-b4c1-4604-bdbe-f06b02f2c16c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:45:59.947427 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a55a9a8c-b4c1-4604-bdbe-f06b02f2c16c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:45:59.953461 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a55a9a8c-b4c1-4604-bdbe-f06b02f2c16c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:59.953906 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a55a9a8c-b4c1-4604-bdbe-f06b02f2c16c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:45:59.954714 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a55a9a8c-b4c1-4604-bdbe-f06b02f2c16c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:45:59.955148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a55a9a8c-b4c1-4604-bdbe-f06b02f2c16c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:00.168273 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a55a9a8c-b4c1-4604-bdbe-f06b02f2c16c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:00.176094 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a55a9a8c-b4c1-4604-bdbe-f06b02f2c16c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1317 microversion: 2.1 time: 0.234058 May 27 09:46:00.176662 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 387/763] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:45:59 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:01.192851 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f166ca27-ac19-435b-97cd-2b938d1e09a5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:01.193500 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f166ca27-ac19-435b-97cd-2b938d1e09a5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:01.199764 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f166ca27-ac19-435b-97cd-2b938d1e09a5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:01.200217 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f166ca27-ac19-435b-97cd-2b938d1e09a5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:01.201239 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f166ca27-ac19-435b-97cd-2b938d1e09a5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:01.201850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f166ca27-ac19-435b-97cd-2b938d1e09a5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:01.335551 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f166ca27-ac19-435b-97cd-2b938d1e09a5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:01.344364 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f166ca27-ac19-435b-97cd-2b938d1e09a5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1317 microversion: 2.1 time: 0.155240 May 27 09:46:01.344929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 377/764] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:01 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:02.361489 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9fad02d3-6944-4301-bf3b-561ae844fdd1 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:02.362114 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9fad02d3-6944-4301-bf3b-561ae844fdd1 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:02.367770 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=6 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:02.370676 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9fad02d3-6944-4301-bf3b-561ae844fdd1 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:02.371139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9fad02d3-6944-4301-bf3b-561ae844fdd1 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:02.371920 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9fad02d3-6944-4301-bf3b-561ae844fdd1 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:02.373183 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9fad02d3-6944-4301-bf3b-561ae844fdd1 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:02.572728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9fad02d3-6944-4301-bf3b-561ae844fdd1 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:02.580260 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9fad02d3-6944-4301-bf3b-561ae844fdd1 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1317 microversion: 2.1 time: 0.223210 May 27 09:46:02.580818 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 388/765] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:02 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1317 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:03.598618 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5b271414-8b1f-4c59-8914-ddfc1dc08375 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:03.599317 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5b271414-8b1f-4c59-8914-ddfc1dc08375 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:03.602062 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:03.608125 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5b271414-8b1f-4c59-8914-ddfc1dc08375 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:03.608637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5b271414-8b1f-4c59-8914-ddfc1dc08375 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:03.609407 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5b271414-8b1f-4c59-8914-ddfc1dc08375 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:03.609834 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5b271414-8b1f-4c59-8914-ddfc1dc08375 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:03.763801 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-5b271414-8b1f-4c59-8914-ddfc1dc08375 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:03.777070 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5b271414-8b1f-4c59-8914-ddfc1dc08375 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1317 microversion: 2.1 time: 0.181464 May 27 09:46:03.777070 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 378/766] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:03 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1317 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:04.792280 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ced191da-efb7-4155-916e-15d8cb30dc4c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:04.792879 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ced191da-efb7-4155-916e-15d8cb30dc4c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:04.799901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ced191da-efb7-4155-916e-15d8cb30dc4c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:04.800349 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ced191da-efb7-4155-916e-15d8cb30dc4c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:04.801122 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ced191da-efb7-4155-916e-15d8cb30dc4c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:04.801561 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ced191da-efb7-4155-916e-15d8cb30dc4c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:04.936270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ced191da-efb7-4155-916e-15d8cb30dc4c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:04.947815 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ced191da-efb7-4155-916e-15d8cb30dc4c tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1317 microversion: 2.1 time: 0.155753 May 27 09:46:04.947815 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 389/767] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:04 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:46:05.332526 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-d16c8962-200c-4c84-aa72-63a198ef9693 req-f18a500f-7b9c-47e5-8456-ec01203123b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e594966b-9aeb-4686-99df-3bff0a8f1c92", "name": "network-vif-plugged", "status": "completed", "tag": "78434af1-6c26-4b3b-a4b3-775e641ef393"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:05.342766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-d16c8962-200c-4c84-aa72-63a198ef9693 req-f18a500f-7b9c-47e5-8456-ec01203123b4 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:05.342766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-d16c8962-200c-4c84-aa72-63a198ef9693 req-f18a500f-7b9c-47e5-8456-ec01203123b4 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:05.353843 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-d16c8962-200c-4c84-aa72-63a198ef9693 req-f18a500f-7b9c-47e5-8456-ec01203123b4 service nova] Creating event network-vif-plugged:78434af1-6c26-4b3b-a4b3-775e641ef393 for instance e594966b-9aeb-4686-99df-3bff0a8f1c92 on hv-cinder-82549 May 27 09:46:05.359618 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-d16c8962-200c-4c84-aa72-63a198ef9693 req-f18a500f-7b9c-47e5-8456-ec01203123b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030816 May 27 09:46:05.360209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 379/768] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:05.961440 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b18db8f1-158d-4b8a-b360-c3f515bfcb99 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:05.962122 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b18db8f1-158d-4b8a-b360-c3f515bfcb99 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:05.964449 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:05.969840 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b18db8f1-158d-4b8a-b360-c3f515bfcb99 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:05.970321 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b18db8f1-158d-4b8a-b360-c3f515bfcb99 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:05.971081 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b18db8f1-158d-4b8a-b360-c3f515bfcb99 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:05.971513 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b18db8f1-158d-4b8a-b360-c3f515bfcb99 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:06.108418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b18db8f1-158d-4b8a-b360-c3f515bfcb99 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:06.116120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b18db8f1-158d-4b8a-b360-c3f515bfcb99 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1317 microversion: 2.1 time: 0.158545 May 27 09:46:06.116688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 390/769] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:05 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:07.133413 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e8a6856a-1f77-468e-b89b-e26943a74eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:07.134120 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e8a6856a-1f77-468e-b89b-e26943a74eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:07.141485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e8a6856a-1f77-468e-b89b-e26943a74eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:07.164311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e8a6856a-1f77-468e-b89b-e26943a74eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:07.164311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e8a6856a-1f77-468e-b89b-e26943a74eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:07.164311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e8a6856a-1f77-468e-b89b-e26943a74eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:07.307043 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e8a6856a-1f77-468e-b89b-e26943a74eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:07.315419 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e8a6856a-1f77-468e-b89b-e26943a74eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1317 microversion: 2.1 time: 0.186659 May 27 09:46:07.319700 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 380/770] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:07 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1317 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:08.331786 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8e2cb781-a935-4876-9d32-b005ec147ca8 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:08.332372 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8e2cb781-a935-4876-9d32-b005ec147ca8 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:08.339656 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8e2cb781-a935-4876-9d32-b005ec147ca8 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:08.340206 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8e2cb781-a935-4876-9d32-b005ec147ca8 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:08.340866 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8e2cb781-a935-4876-9d32-b005ec147ca8 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:08.341292 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8e2cb781-a935-4876-9d32-b005ec147ca8 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:08.473484 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8e2cb781-a935-4876-9d32-b005ec147ca8 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:08.488658 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8e2cb781-a935-4876-9d32-b005ec147ca8 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1506 microversion: 2.1 time: 0.160650 May 27 09:46:08.496710 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 391/771] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:08 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:13.224022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-04fa24bd-4c28-4bb8-9bc5-337168a0a576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: .version_select at 0x7fbe323ceb80>, body: {"keypair": {"name": "tempest-keypair-729270524", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE0vD0sBhbA9mCFlX3RP9qZ8t/WnsuDEqooqerBE+pTUQDwp/O/VH//rlZkwqljElS8snRQJhr0CalhfuHQzgDw4rXqoj6EHdjRQDiWQhv3g5IYqCCiBBtGDwG84xM1Kww=="}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:13.238642 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-04fa24bd-4c28-4bb8-9bc5-337168a0a576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for project 1b2ae84b95ae44d18119450b94735f03. Resources: {'key_pairs'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:46:13.242964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-04fa24bd-4c28-4bb8-9bc5-337168a0a576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for user 6772c708b48b404bb9f8794142ec6060 and project 1b2ae84b95ae44d18119450b94735f03. Resources: {'key_pairs'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:46:13.346241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-04fa24bd-4c28-4bb8-9bc5-337168a0a576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.254753 May 27 09:46:13.346864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 381/772] 10.222.0.48 () {60 vars in 1158 bytes} [Fri May 27 09:46:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:16.115753 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1299510552", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "924af2e1-0920-4407-a4e8-e35b1f67efeb"}], "security_groups": [{"name": "tempest-securitygroup--1055218244"}], "key_name": "tempest-keypair-729270524", "user_data": "}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:16.229147 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.network.neutron [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] validate_networks() for [('924af2e1-0920-4407-a4e8-e35b1f67efeb', None, None, None, None, None)] {{(pid=124829) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:46:16.681645 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Flavor limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:46:16.682176 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Image limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:46:16.682749 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Flavor pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:46:16.683229 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Image pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:46:16.683705 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:46:16.693521 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:16.694143 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:16.702539 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:16.702539 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:16.717302 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for project 1b2ae84b95ae44d18119450b94735f03. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:46:16.721644 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for user 6772c708b48b404bb9f8794142ec6060 and project 1b2ae84b95ae44d18119450b94735f03. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:46:16.733494 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Going to run 1 instances... {{(pid=124829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:46:16.735857 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:46:16.915980 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d56129dd-9f87-494c-9f04-839f9cfb1969 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.804698 May 27 09:46:16.916551 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 392/773] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:46:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:46:16.926770 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d4e7683f-4b85-42a3-a2c1-95a10cb3a395 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:16.927394 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d4e7683f-4b85-42a3-a2c1-95a10cb3a395 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:16.985548 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d4e7683f-4b85-42a3-a2c1-95a10cb3a395 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:16.997629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d4e7683f-4b85-42a3-a2c1-95a10cb3a395 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1241 microversion: 2.1 time: 0.073998 May 27 09:46:16.998479 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 382/774] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:16 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:18.015383 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9002e72b-1bd5-43ce-a903-ff510c7b8657 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:18.016014 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9002e72b-1bd5-43ce-a903-ff510c7b8657 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:18.068786 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9002e72b-1bd5-43ce-a903-ff510c7b8657 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:18.075700 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9002e72b-1bd5-43ce-a903-ff510c7b8657 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1241 microversion: 2.1 time: 0.064738 May 27 09:46:18.076261 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 393/775] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:18 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:19.093159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4c607845-ba41-4bb4-a3b3-41afaabad094 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:19.093770 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4c607845-ba41-4bb4-a3b3-41afaabad094 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:19.095756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=36 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:19.101166 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4c607845-ba41-4bb4-a3b3-41afaabad094 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:19.101628 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4c607845-ba41-4bb4-a3b3-41afaabad094 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:19.102422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4c607845-ba41-4bb4-a3b3-41afaabad094 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:19.102861 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4c607845-ba41-4bb4-a3b3-41afaabad094 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:19.167605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4c607845-ba41-4bb4-a3b3-41afaabad094 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:19.175540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4c607845-ba41-4bb4-a3b3-41afaabad094 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1237 microversion: 2.1 time: 0.086387 May 27 09:46:19.176151 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 383/776] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:19 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1237 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:20.193019 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-33f7fc89-115d-434f-bb1c-2dd55781e1f2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:20.193786 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-33f7fc89-115d-434f-bb1c-2dd55781e1f2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:20.201633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33f7fc89-115d-434f-bb1c-2dd55781e1f2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:20.202165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33f7fc89-115d-434f-bb1c-2dd55781e1f2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:20.202955 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33f7fc89-115d-434f-bb1c-2dd55781e1f2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:20.203387 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33f7fc89-115d-434f-bb1c-2dd55781e1f2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:20.279927 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-33f7fc89-115d-434f-bb1c-2dd55781e1f2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:20.287493 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-33f7fc89-115d-434f-bb1c-2dd55781e1f2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1311 microversion: 2.1 time: 0.098478 May 27 09:46:20.288058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 394/777] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:20 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:21.305699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-31ea1275-af1c-4ae8-bb84-65c91e156662 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:21.306345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-31ea1275-af1c-4ae8-bb84-65c91e156662 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:21.313192 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-31ea1275-af1c-4ae8-bb84-65c91e156662 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:21.313639 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-31ea1275-af1c-4ae8-bb84-65c91e156662 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:21.314443 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-31ea1275-af1c-4ae8-bb84-65c91e156662 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:21.314892 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-31ea1275-af1c-4ae8-bb84-65c91e156662 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:21.451280 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-31ea1275-af1c-4ae8-bb84-65c91e156662 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:21.458850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-31ea1275-af1c-4ae8-bb84-65c91e156662 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1367 microversion: 2.1 time: 0.157508 May 27 09:46:21.459442 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 384/778] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:21 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:21.930948 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-f25b8807-9d38-4625-8528-e561c8b8f75d req-a67fe26a-5fff-4e23-b403-2c9eaaffb04b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d52913b-ebb2-470d-aafe-129bead9bedf", "tag": "7a6aa9ff-d804-497b-a4d3-1d5d81882bcd"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:21.942162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-f25b8807-9d38-4625-8528-e561c8b8f75d req-a67fe26a-5fff-4e23-b403-2c9eaaffb04b service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:21.943109 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-f25b8807-9d38-4625-8528-e561c8b8f75d req-a67fe26a-5fff-4e23-b403-2c9eaaffb04b service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:21.966054 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-f25b8807-9d38-4625-8528-e561c8b8f75d req-a67fe26a-5fff-4e23-b403-2c9eaaffb04b service nova] Creating event network-changed:7a6aa9ff-d804-497b-a4d3-1d5d81882bcd for instance 1d52913b-ebb2-470d-aafe-129bead9bedf on hv-cinder-82549 May 27 09:46:21.966054 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-f25b8807-9d38-4625-8528-e561c8b8f75d req-a67fe26a-5fff-4e23-b403-2c9eaaffb04b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032866 May 27 09:46:21.966054 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 395/779] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:22.476450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-854c5c57-cc61-4706-90b1-3fad502f6ea9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:22.477070 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-854c5c57-cc61-4706-90b1-3fad502f6ea9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:22.484190 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-854c5c57-cc61-4706-90b1-3fad502f6ea9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:22.484646 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-854c5c57-cc61-4706-90b1-3fad502f6ea9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:22.485463 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-854c5c57-cc61-4706-90b1-3fad502f6ea9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:22.485850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-854c5c57-cc61-4706-90b1-3fad502f6ea9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:22.626825 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-854c5c57-cc61-4706-90b1-3fad502f6ea9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:22.634238 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-854c5c57-cc61-4706-90b1-3fad502f6ea9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1367 microversion: 2.1 time: 0.161633 May 27 09:46:22.634814 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 385/780] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:22 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:23.652290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-bd80a030-86fe-4620-a404-0dadd291d476 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:23.652987 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-bd80a030-86fe-4620-a404-0dadd291d476 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:23.659658 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bd80a030-86fe-4620-a404-0dadd291d476 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:23.660106 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bd80a030-86fe-4620-a404-0dadd291d476 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:23.660874 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bd80a030-86fe-4620-a404-0dadd291d476 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:23.661311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bd80a030-86fe-4620-a404-0dadd291d476 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:23.794470 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-bd80a030-86fe-4620-a404-0dadd291d476 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:23.802166 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-bd80a030-86fe-4620-a404-0dadd291d476 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1367 microversion: 2.1 time: 0.154579 May 27 09:46:23.802748 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 396/781] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:23 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:24.819702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d7b5315b-0741-4578-a806-10e9e7b08ac0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:24.820355 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d7b5315b-0741-4578-a806-10e9e7b08ac0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:24.827600 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d7b5315b-0741-4578-a806-10e9e7b08ac0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:24.827972 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d7b5315b-0741-4578-a806-10e9e7b08ac0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:24.828729 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d7b5315b-0741-4578-a806-10e9e7b08ac0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:24.829163 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d7b5315b-0741-4578-a806-10e9e7b08ac0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:24.955365 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d7b5315b-0741-4578-a806-10e9e7b08ac0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:24.962883 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d7b5315b-0741-4578-a806-10e9e7b08ac0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1367 microversion: 2.1 time: 0.147152 May 27 09:46:24.963469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 386/782] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:24 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:25.981335 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-12938c97-37d7-4807-89cd-2c993334dfd6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:25.982225 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-12938c97-37d7-4807-89cd-2c993334dfd6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:25.991311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-12938c97-37d7-4807-89cd-2c993334dfd6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:25.991990 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-12938c97-37d7-4807-89cd-2c993334dfd6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:25.992981 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-12938c97-37d7-4807-89cd-2c993334dfd6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:25.993557 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-12938c97-37d7-4807-89cd-2c993334dfd6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:26.132813 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-12938c97-37d7-4807-89cd-2c993334dfd6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:26.140648 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-12938c97-37d7-4807-89cd-2c993334dfd6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1367 microversion: 2.1 time: 0.164180 May 27 09:46:26.141190 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 397/783] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:25 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:27.158973 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1966dbe9-1e23-4ce3-afc0-6dce1c1f65e5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:27.159605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1966dbe9-1e23-4ce3-afc0-6dce1c1f65e5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:27.161463 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=6 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:27.166233 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1966dbe9-1e23-4ce3-afc0-6dce1c1f65e5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:27.166673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1966dbe9-1e23-4ce3-afc0-6dce1c1f65e5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:27.167433 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1966dbe9-1e23-4ce3-afc0-6dce1c1f65e5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:27.167862 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1966dbe9-1e23-4ce3-afc0-6dce1c1f65e5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:27.356190 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1966dbe9-1e23-4ce3-afc0-6dce1c1f65e5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:27.368535 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1966dbe9-1e23-4ce3-afc0-6dce1c1f65e5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1367 microversion: 2.1 time: 0.213533 May 27 09:46:27.369307 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 387/784] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:27 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:28.386177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-10f2f9c8-d242-4490-8cc2-e99d6ffd3686 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:28.386819 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-10f2f9c8-d242-4490-8cc2-e99d6ffd3686 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:28.390530 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:28.391735 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=8 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:28.395375 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-10f2f9c8-d242-4490-8cc2-e99d6ffd3686 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:28.395826 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-10f2f9c8-d242-4490-8cc2-e99d6ffd3686 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:28.396603 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-10f2f9c8-d242-4490-8cc2-e99d6ffd3686 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:28.397041 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-10f2f9c8-d242-4490-8cc2-e99d6ffd3686 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:28.534462 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-10f2f9c8-d242-4490-8cc2-e99d6ffd3686 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:28.542617 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-10f2f9c8-d242-4490-8cc2-e99d6ffd3686 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1367 microversion: 2.1 time: 0.161068 May 27 09:46:28.543118 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 398/785] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:28 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:29.422229 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-92e78205-8dcf-4234-a750-72adfcf6af4f req-22808e97-6a78-46e6-bcb7-08f029537ab0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d52913b-ebb2-470d-aafe-129bead9bedf", "name": "network-vif-plugged", "status": "completed", "tag": "7a6aa9ff-d804-497b-a4d3-1d5d81882bcd"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:29.430810 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-92e78205-8dcf-4234-a750-72adfcf6af4f req-22808e97-6a78-46e6-bcb7-08f029537ab0 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:29.431494 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-92e78205-8dcf-4234-a750-72adfcf6af4f req-22808e97-6a78-46e6-bcb7-08f029537ab0 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:29.442976 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-92e78205-8dcf-4234-a750-72adfcf6af4f req-22808e97-6a78-46e6-bcb7-08f029537ab0 service nova] Creating event network-vif-plugged:7a6aa9ff-d804-497b-a4d3-1d5d81882bcd for instance 1d52913b-ebb2-470d-aafe-129bead9bedf on hv-cinder-82549 May 27 09:46:29.448031 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-92e78205-8dcf-4234-a750-72adfcf6af4f req-22808e97-6a78-46e6-bcb7-08f029537ab0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030346 May 27 09:46:29.448680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 388/786] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:29.559648 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-baefef6a-5c3d-4df5-a3c7-bda045f3752a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:29.560254 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-baefef6a-5c3d-4df5-a3c7-bda045f3752a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:29.567069 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-baefef6a-5c3d-4df5-a3c7-bda045f3752a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:29.567523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-baefef6a-5c3d-4df5-a3c7-bda045f3752a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:29.568939 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-baefef6a-5c3d-4df5-a3c7-bda045f3752a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:29.568939 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-baefef6a-5c3d-4df5-a3c7-bda045f3752a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:29.701392 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-baefef6a-5c3d-4df5-a3c7-bda045f3752a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:29.709054 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-baefef6a-5c3d-4df5-a3c7-bda045f3752a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1367 microversion: 2.1 time: 0.153487 May 27 09:46:29.709634 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 399/787] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:29 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:46:30.728058 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-aac2d5bd-868f-40ee-b06c-7825436e193f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:30.728701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-aac2d5bd-868f-40ee-b06c-7825436e193f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:30.735612 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aac2d5bd-868f-40ee-b06c-7825436e193f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:30.736063 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aac2d5bd-868f-40ee-b06c-7825436e193f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:30.736834 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aac2d5bd-868f-40ee-b06c-7825436e193f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:30.737273 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aac2d5bd-868f-40ee-b06c-7825436e193f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:30.869381 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-aac2d5bd-868f-40ee-b06c-7825436e193f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:30.877508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-aac2d5bd-868f-40ee-b06c-7825436e193f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1367 microversion: 2.1 time: 0.154286 May 27 09:46:30.878074 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 389/788] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:30 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:31.894766 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b24df5c4-a0d0-4515-8567-4c6d41e80c07 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:31.895379 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b24df5c4-a0d0-4515-8567-4c6d41e80c07 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:31.901962 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b24df5c4-a0d0-4515-8567-4c6d41e80c07 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:31.902443 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b24df5c4-a0d0-4515-8567-4c6d41e80c07 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:31.903249 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b24df5c4-a0d0-4515-8567-4c6d41e80c07 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:31.903707 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b24df5c4-a0d0-4515-8567-4c6d41e80c07 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:31.906587 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=76 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:32.048403 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b24df5c4-a0d0-4515-8567-4c6d41e80c07 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:32.056247 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b24df5c4-a0d0-4515-8567-4c6d41e80c07 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1367 microversion: 2.1 time: 0.165318 May 27 09:46:32.064919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 400/789] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:31 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:32.645875 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9227264e-c275-4adb-9a18-1f0120d879ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9771cbc-b256-4fe5-8a3e-1170316ce7d8", "device": "/dev/sdb"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:32.647476 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9227264e-c275-4adb-9a18-1f0120d879ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:32.654699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9227264e-c275-4adb-9a18-1f0120d879ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:32.655153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9227264e-c275-4adb-9a18-1f0120d879ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:32.655924 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9227264e-c275-4adb-9a18-1f0120d879ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:32.656360 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9227264e-c275-4adb-9a18-1f0120d879ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.074544 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-13abde9c-49eb-4271-bcfb-72f7eaf08ab3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:33.075170 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-13abde9c-49eb-4271-bcfb-72f7eaf08ab3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:33.082127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-13abde9c-49eb-4271-bcfb-72f7eaf08ab3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:33.087558 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-13abde9c-49eb-4271-bcfb-72f7eaf08ab3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.087558 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-13abde9c-49eb-4271-bcfb-72f7eaf08ab3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:33.087558 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-13abde9c-49eb-4271-bcfb-72f7eaf08ab3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.219199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-13abde9c-49eb-4271-bcfb-72f7eaf08ab3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:33.227965 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-13abde9c-49eb-4271-bcfb-72f7eaf08ab3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1557 microversion: 2.1 time: 0.157464 May 27 09:46:33.228830 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 401/790] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:46:33 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:46:33.245207 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-40b7a0b1-9ad9-49d9-b969-5c0bf7aeede6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:33.245705 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-40b7a0b1-9ad9-49d9-b969-5c0bf7aeede6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:33.252820 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-40b7a0b1-9ad9-49d9-b969-5c0bf7aeede6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:33.253271 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-40b7a0b1-9ad9-49d9-b969-5c0bf7aeede6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.254051 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-40b7a0b1-9ad9-49d9-b969-5c0bf7aeede6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:33.254539 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-40b7a0b1-9ad9-49d9-b969-5c0bf7aeede6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:33.348502 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-40b7a0b1-9ad9-49d9-b969-5c0bf7aeede6 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107074 May 27 09:46:33.350869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 402/791] 10.222.0.48 () {58 vars in 1274 bytes} [Fri May 27 09:46:33 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:46:33.977167 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9227264e-c275-4adb-9a18-1f0120d879ae tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "POST /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.335088 May 27 09:46:33.977947 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 390/792] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:46:32 2022] POST /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92/os-volume_attachments => generated 194 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:46:34.588426 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-39c12e13-68a9-4cb2-8d99-dc75d07adfc8 req-d7f237b3-ea2b-464e-aab2-4e8105a94f06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d52913b-ebb2-470d-aafe-129bead9bedf", "tag": "7a6aa9ff-d804-497b-a4d3-1d5d81882bcd"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:34.597518 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-39c12e13-68a9-4cb2-8d99-dc75d07adfc8 req-d7f237b3-ea2b-464e-aab2-4e8105a94f06 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:34.597972 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-39c12e13-68a9-4cb2-8d99-dc75d07adfc8 req-d7f237b3-ea2b-464e-aab2-4e8105a94f06 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:34.610092 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-39c12e13-68a9-4cb2-8d99-dc75d07adfc8 req-d7f237b3-ea2b-464e-aab2-4e8105a94f06 service nova] Creating event network-changed:7a6aa9ff-d804-497b-a4d3-1d5d81882bcd for instance 1d52913b-ebb2-470d-aafe-129bead9bedf on hv-cinder-82549 May 27 09:46:34.615346 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-39c12e13-68a9-4cb2-8d99-dc75d07adfc8 req-d7f237b3-ea2b-464e-aab2-4e8105a94f06 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094947 May 27 09:46:34.616256 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 403/793] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:41.579519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-78f918a6-8ccd-4cbc-b481-fe0a42e85810 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:41.580586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-78f918a6-8ccd-4cbc-b481-fe0a42e85810 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:41.587283 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-78f918a6-8ccd-4cbc-b481-fe0a42e85810 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:41.587735 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-78f918a6-8ccd-4cbc-b481-fe0a42e85810 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:41.588540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-78f918a6-8ccd-4cbc-b481-fe0a42e85810 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:41.588984 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-78f918a6-8ccd-4cbc-b481-fe0a42e85810 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:41.618963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-78f918a6-8ccd-4cbc-b481-fe0a42e85810 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044641 May 27 09:46:41.619541 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 391/794] 10.222.0.48 () {60 vars in 1342 bytes} [Fri May 27 09:46:41 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:46:41.680337 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a0da7036-c8fc-4c0f-bdab-fde7931b4599 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:41.680913 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a0da7036-c8fc-4c0f-bdab-fde7931b4599 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:41.687846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a0da7036-c8fc-4c0f-bdab-fde7931b4599 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:41.691565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a0da7036-c8fc-4c0f-bdab-fde7931b4599 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:41.691565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a0da7036-c8fc-4c0f-bdab-fde7931b4599 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:41.691565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a0da7036-c8fc-4c0f-bdab-fde7931b4599 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:41.714389 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a0da7036-c8fc-4c0f-bdab-fde7931b4599 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:46:42.159386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a0da7036-c8fc-4c0f-bdab-fde7931b4599 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 204 len: 0 microversion: 2.20 time: 0.482903 May 27 09:46:42.159981 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 404/795] 10.222.0.48 () {60 vars in 1279 bytes} [Fri May 27 09:46:41 2022] DELETE /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 09:46:42.168284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-78dd7464-d97d-424c-9302-3876e45e3950 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:42.168889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-78dd7464-d97d-424c-9302-3876e45e3950 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:42.175410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-78dd7464-d97d-424c-9302-3876e45e3950 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:42.175858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-78dd7464-d97d-424c-9302-3876e45e3950 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:42.176622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-78dd7464-d97d-424c-9302-3876e45e3950 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:42.177045 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-78dd7464-d97d-424c-9302-3876e45e3950 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:42.312464 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-78dd7464-d97d-424c-9302-3876e45e3950 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:42.320837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-78dd7464-d97d-424c-9302-3876e45e3950 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:42.327291 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-78dd7464-d97d-424c-9302-3876e45e3950 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:42.327291 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-78dd7464-d97d-424c-9302-3876e45e3950 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.159148 May 27 09:46:42.327291 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 392/796] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:46:42 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:43.343492 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2daa3c37-4532-49f6-b7a7-d2d7c14227d9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:43.344201 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2daa3c37-4532-49f6-b7a7-d2d7c14227d9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:43.351015 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2daa3c37-4532-49f6-b7a7-d2d7c14227d9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:43.351467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2daa3c37-4532-49f6-b7a7-d2d7c14227d9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:43.352245 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2daa3c37-4532-49f6-b7a7-d2d7c14227d9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:43.352688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2daa3c37-4532-49f6-b7a7-d2d7c14227d9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:43.541020 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2daa3c37-4532-49f6-b7a7-d2d7c14227d9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:43.549546 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2daa3c37-4532-49f6-b7a7-d2d7c14227d9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:43.551074 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2daa3c37-4532-49f6-b7a7-d2d7c14227d9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:43.552255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2daa3c37-4532-49f6-b7a7-d2d7c14227d9 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1722 microversion: 2.20 time: 0.213748 May 27 09:46:43.552809 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 405/797] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:46:43 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:44.570837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fd450380-4c08-4cc6-ad47-706a2a213d60 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:44.572194 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fd450380-4c08-4cc6-ad47-706a2a213d60 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:44.575729 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:44.580819 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd450380-4c08-4cc6-ad47-706a2a213d60 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:44.581274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd450380-4c08-4cc6-ad47-706a2a213d60 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:44.582071 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd450380-4c08-4cc6-ad47-706a2a213d60 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:44.582546 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fd450380-4c08-4cc6-ad47-706a2a213d60 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:44.651403 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fd450380-4c08-4cc6-ad47-706a2a213d60 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:44.659673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fd450380-4c08-4cc6-ad47-706a2a213d60 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:44.661198 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fd450380-4c08-4cc6-ad47-706a2a213d60 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:44.662422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fd450380-4c08-4cc6-ad47-706a2a213d60 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1655 microversion: 2.20 time: 0.095689 May 27 09:46:44.673181 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 393/798] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:46:44 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1655 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:44.761705 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-72125211-e4be-466c-bc60-7bb1548fdf9a req-fd1565f0-058a-42ea-a382-07bd54a211a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5509199-188d-42fe-9ba4-86939ff60815", "name": "network-vif-deleted", "tag": "b4210cbf-916a-49c1-8183-605e8128c6d0"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:46:44.778347 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-72125211-e4be-466c-bc60-7bb1548fdf9a req-fd1565f0-058a-42ea-a382-07bd54a211a1 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:44.779231 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-72125211-e4be-466c-bc60-7bb1548fdf9a req-fd1565f0-058a-42ea-a382-07bd54a211a1 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:44.791457 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-72125211-e4be-466c-bc60-7bb1548fdf9a req-fd1565f0-058a-42ea-a382-07bd54a211a1 service nova] Creating event network-vif-deleted:b4210cbf-916a-49c1-8183-605e8128c6d0 for instance c5509199-188d-42fe-9ba4-86939ff60815 on hv-cinder-82549 May 27 09:46:44.797074 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-72125211-e4be-466c-bc60-7bb1548fdf9a req-fd1565f0-058a-42ea-a382-07bd54a211a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038745 May 27 09:46:44.802993 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 406/799] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:46:45.681509 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-93f2919d-143b-46cc-8610-7b76820c850c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:45.686701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-93f2919d-143b-46cc-8610-7b76820c850c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:45.689651 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-93f2919d-143b-46cc-8610-7b76820c850c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:45.690100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-93f2919d-143b-46cc-8610-7b76820c850c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:45.690909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-93f2919d-143b-46cc-8610-7b76820c850c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:45.691348 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-93f2919d-143b-46cc-8610-7b76820c850c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:45.759385 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-93f2919d-143b-46cc-8610-7b76820c850c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:45.768690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-93f2919d-143b-46cc-8610-7b76820c850c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:45.770469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-93f2919d-143b-46cc-8610-7b76820c850c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:45.771615 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-93f2919d-143b-46cc-8610-7b76820c850c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1366 microversion: 2.20 time: 0.094517 May 27 09:46:45.772179 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 394/800] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:46:45 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1366 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:46.790584 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-812f6df1-8e30-451c-97d0-1ab38df8c70a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:46.791284 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-812f6df1-8e30-451c-97d0-1ab38df8c70a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:46.793278 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:46.799102 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-812f6df1-8e30-451c-97d0-1ab38df8c70a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:46.799546 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-812f6df1-8e30-451c-97d0-1ab38df8c70a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:46.800312 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-812f6df1-8e30-451c-97d0-1ab38df8c70a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:46.800746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-812f6df1-8e30-451c-97d0-1ab38df8c70a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:46.866405 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-812f6df1-8e30-451c-97d0-1ab38df8c70a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:46.874668 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-812f6df1-8e30-451c-97d0-1ab38df8c70a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:46.876149 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-812f6df1-8e30-451c-97d0-1ab38df8c70a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:46.877291 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-812f6df1-8e30-451c-97d0-1ab38df8c70a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1366 microversion: 2.20 time: 0.091558 May 27 09:46:46.877854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 407/801] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:46:46 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1366 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:47.895353 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:47.895936 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:47.903605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:47.904049 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:47.904815 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:47.905247 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:47.939139 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:47.939580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:47.940021 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lazy-loading 'fault' on Instance uuid c5509199-188d-42fe-9ba4-86939ff60815 {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:46:47.981455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:47.990418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:47.991925 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8d52fe5018e2450dad79596fb1129c64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '836f9646586d4f409c181cdbfa24cb32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:46:47.993113 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8b6c5fa3-71ef-4c3f-a926-1a11df892aeb tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 200 len: 1371 microversion: 2.20 time: 0.101768 May 27 09:46:47.994080 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 395/802] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:46:47 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 1371 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 27 09:46:49.011071 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-597fc0a8-4a88-4a78-8c38-19462bcf6d7c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:49.011694 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-597fc0a8-4a88-4a78-8c38-19462bcf6d7c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:49.018476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-597fc0a8-4a88-4a78-8c38-19462bcf6d7c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:49.018931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-597fc0a8-4a88-4a78-8c38-19462bcf6d7c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:49.019691 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-597fc0a8-4a88-4a78-8c38-19462bcf6d7c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:49.020145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-597fc0a8-4a88-4a78-8c38-19462bcf6d7c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:49.033811 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-597fc0a8-4a88-4a78-8c38-19462bcf6d7c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] HTTP exception thrown: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-597fc0a8-4a88-4a78-8c38-19462bcf6d7c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Request method failure captured: May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 HTTP/1.1 May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuiEUuljjOp6ZFyFHZE2cCiW-lctnUqc4PVDTD-NI_Y30XHmA1PCvSOn9tCVvRbfOBfz9WL7yybcj_I0TksWO-O8UlmqQE4ZQ4JGzOlmTF4uwdxz5_YiAKjcwCCXBNiN9-NT_bULv1dU_4ApgS0uFLx5kM0VrgPafDNv58DBpBDb2Q May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:46:49.041633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_836f9646586d4f409c181cdbfa24cb32", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 8d52fe5018e2450dad79596fb1129c64 May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:49.044186 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': 'c5509199-188d-42fe-9ba4-86939ff60815'} May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:46:49.045086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:49.046619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:49.048209 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-597fc0a8-4a88-4a78-8c38-19462bcf6d7c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Returning 404 to user: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:46:49.048209 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-597fc0a8-4a88-4a78-8c38-19462bcf6d7c tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 404 len: 111 microversion: 2.20 time: 0.029740 May 27 09:46:49.048209 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 408/803] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:46:49 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 09:46:49.048472 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-db87a218-e69f-49f7-9afb-4fb78360831a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '.version_select at 0x7fbe3236ee50>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:49.196587 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-db87a218-e69f-49f7-9afb-4fb78360831a tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861537304" status: 204 len: 0 microversion: 2.20 time: 0.154584 May 27 09:46:49.197091 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 396/804] 10.222.0.48 () {60 vars in 1261 bytes} [Fri May 27 09:46:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1861537304 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 27 09:46:54.801930 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a9fb4b54-f059-4bbd-98e7-f2d9c3ff67c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:54.802511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a9fb4b54-f059-4bbd-98e7-f2d9c3ff67c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:54.809676 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a9fb4b54-f059-4bbd-98e7-f2d9c3ff67c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:54.810426 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a9fb4b54-f059-4bbd-98e7-f2d9c3ff67c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:54.811198 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a9fb4b54-f059-4bbd-98e7-f2d9c3ff67c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:54.811643 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a9fb4b54-f059-4bbd-98e7-f2d9c3ff67c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:54.825334 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-a9fb4b54-f059-4bbd-98e7-f2d9c3ff67c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] HTTP exception thrown: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a9fb4b54-f059-4bbd-98e7-f2d9c3ff67c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Request method failure captured: May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 HTTP/1.1 May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuiEUuljjOp6ZFyFHZE2cCiW-lctnUqc4PVDTD-NI_Y30XHmA1PCvSOn9tCVvRbfOBfz9WL7yybcj_I0TksWO-O8UlmqQE4ZQ4JGzOlmTF4uwdxz5_YiAKjcwCCXBNiN9-NT_bULv1dU_4ApgS0uFLx5kM0VrgPafDNv58DBpBDb2Q May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:46:54.827386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_836f9646586d4f409c181cdbfa24cb32", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 8d52fe5018e2450dad79596fb1129c64 May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:54.829012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': 'c5509199-188d-42fe-9ba4-86939ff60815'} May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:46:54.832629 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:54.834070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:54.835530 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a9fb4b54-f059-4bbd-98e7-f2d9c3ff67c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Returning 404 to user: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:46:54.835530 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a9fb4b54-f059-4bbd-98e7-f2d9c3ff67c2 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 404 len: 111 microversion: 2.20 time: 0.030835 May 27 09:46:54.835530 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 409/805] 10.222.0.48 () {60 vars in 1279 bytes} [Fri May 27 09:46:54 2022] DELETE /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 09:46:54.838088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c8b22505-d553-4bcd-aac0-66805f4bdd9b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:54.838765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c8b22505-d553-4bcd-aac0-66805f4bdd9b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: c5509199-188d-42fe-9ba4-86939ff60815] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:54.846481 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c8b22505-d553-4bcd-aac0-66805f4bdd9b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:54.846944 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c8b22505-d553-4bcd-aac0-66805f4bdd9b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:54.847718 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c8b22505-d553-4bcd-aac0-66805f4bdd9b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:54.848161 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c8b22505-d553-4bcd-aac0-66805f4bdd9b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:54.851766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:46:54.862585 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-c8b22505-d553-4bcd-aac0-66805f4bdd9b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] HTTP exception thrown: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c8b22505-d553-4bcd-aac0-66805f4bdd9b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Request method failure captured: May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 HTTP/1.1 May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuiEUuljjOp6ZFyFHZE2cCiW-lctnUqc4PVDTD-NI_Y30XHmA1PCvSOn9tCVvRbfOBfz9WL7yybcj_I0TksWO-O8UlmqQE4ZQ4JGzOlmTF4uwdxz5_YiAKjcwCCXBNiN9-NT_bULv1dU_4ApgS0uFLx5kM0VrgPafDNv58DBpBDb2Q May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:46:54.864274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_836f9646586d4f409c181cdbfa24cb32", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 8d52fe5018e2450dad79596fb1129c64 May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:54.866168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': 'c5509199-188d-42fe-9ba4-86939ff60815'} May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:46:54.867088 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. May 27 09:46:54.868507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:46:54.869780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c8b22505-d553-4bcd-aac0-66805f4bdd9b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Returning 404 to user: Instance c5509199-188d-42fe-9ba4-86939ff60815 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:46:54.869780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c8b22505-d553-4bcd-aac0-66805f4bdd9b tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815" status: 404 len: 111 microversion: 2.20 time: 0.032234 May 27 09:46:54.869780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 397/806] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:46:54 2022] GET /compute/v2.1/servers/c5509199-188d-42fe-9ba4-86939ff60815 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 27 09:46:56.159438 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1e48ee19-ad68-4d1b-859d-b3c2cd91413f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:56.159923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1e48ee19-ad68-4d1b-859d-b3c2cd91413f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:56.166254 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1e48ee19-ad68-4d1b-859d-b3c2cd91413f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:56.166710 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1e48ee19-ad68-4d1b-859d-b3c2cd91413f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:56.167477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1e48ee19-ad68-4d1b-859d-b3c2cd91413f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:56.167913 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1e48ee19-ad68-4d1b-859d-b3c2cd91413f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:56.181358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-1e48ee19-ad68-4d1b-859d-b3c2cd91413f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] HTTP exception thrown: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1e48ee19-ad68-4d1b-859d-b3c2cd91413f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Request method failure captured: May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca HTTP/1.1 May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJuiEUuljjOp6ZFyFHZE2cCiW-lctnUqc4PVDTD-NI_Y30XHmA1PCvSOn9tCVvRbfOBfz9WL7yybcj_I0TksWO-O8UlmqQE4ZQ4JGzOlmTF4uwdxz5_YiAKjcwCCXBNiN9-NT_bULv1dU_4ApgS0uFLx5kM0VrgPafDNv58DBpBDb2Q May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:46:56.182921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_836f9646586d4f409c181cdbfa24cb32", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 8d52fe5018e2450dad79596fb1129c64 May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:46:56.184522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '68f38432-87c8-46fe-b6fe-4795162677ca'} May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:46:56.185386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:46:56.187234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:46:56.188793 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1e48ee19-ad68-4d1b-859d-b3c2cd91413f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Returning 404 to user: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:46:56.188793 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1e48ee19-ad68-4d1b-859d-b3c2cd91413f tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "DELETE /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 404 len: 111 microversion: 2.20 time: 0.029434 May 27 09:46:56.188793 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 410/807] 10.222.0.48 () {60 vars in 1279 bytes} [Fri May 27 09:46:56 2022] DELETE /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 27 09:46:56.192746 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1bda3862-be60-479a-b165-4ba40a2478d0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:46:56.193362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1bda3862-be60-479a-b165-4ba40a2478d0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] [instance: 68f38432-87c8-46fe-b6fe-4795162677ca] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:46:56.200487 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1bda3862-be60-479a-b165-4ba40a2478d0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:56.200935 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1bda3862-be60-479a-b165-4ba40a2478d0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:56.202219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1bda3862-be60-479a-b165-4ba40a2478d0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:46:56.202661 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1bda3862-be60-479a-b165-4ba40a2478d0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:46:56.216059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-1bda3862-be60-479a-b165-4ba40a2478d0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] HTTP exception thrown: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1bda3862-be60-479a-b165-4ba40a2478d0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Request method failure captured: May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca HTTP/1.1 May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJuiEUuljjOp6ZFyFHZE2cCiW-lctnUqc4PVDTD-NI_Y30XHmA1PCvSOn9tCVvRbfOBfz9WL7yybcj_I0TksWO-O8UlmqQE4ZQ4JGzOlmTF4uwdxz5_YiAKjcwCCXBNiN9-NT_bULv1dU_4ApgS0uFLx5kM0VrgPafDNv58DBpBDb2Q May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Openstack-Nova-Api-Version: 2.20 May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:46:56.218222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/836f9646586d4f409c181cdbfa24cb32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_836f9646586d4f409c181cdbfa24cb32", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 836f9646586d4f409c181cdbfa24cb32 May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1099747572 May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 8d52fe5018e2450dad79596fb1129c64 May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1099747572-project May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:46:56.219835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '68f38432-87c8-46fe-b6fe-4795162677ca'} May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:46:56.220982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. May 27 09:46:56.222401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:46:56.223814 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1bda3862-be60-479a-b165-4ba40a2478d0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] Returning 404 to user: Instance 68f38432-87c8-46fe-b6fe-4795162677ca could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:46:56.223814 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1bda3862-be60-479a-b165-4ba40a2478d0 tempest-AttachVolumeShelveTestJSON-1099747572 tempest-AttachVolumeShelveTestJSON-1099747572-project] 10.222.0.48 "GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca" status: 404 len: 111 microversion: 2.20 time: 0.030736 May 27 09:46:56.223814 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 398/808] 10.222.0.48 () {60 vars in 1276 bytes} [Fri May 27 09:46:56 2022] GET /compute/v2.1/servers/68f38432-87c8-46fe-b6fe-4795162677ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 27 09:47:05.331079 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6a72b367-b3ba-40c4-a648-fe33939f87cf tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:05.332970 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6a72b367-b3ba-40c4-a648-fe33939f87cf tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:05.338731 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a72b367-b3ba-40c4-a648-fe33939f87cf tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:05.339176 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a72b367-b3ba-40c4-a648-fe33939f87cf tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:05.339935 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a72b367-b3ba-40c4-a648-fe33939f87cf tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:05.340364 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a72b367-b3ba-40c4-a648-fe33939f87cf tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:05.344198 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:05.425048 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-6a72b367-b3ba-40c4-a648-fe33939f87cf tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lazy-loading 'services' on Instance uuid e594966b-9aeb-4686-99df-3bff0a8f1c92 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:47:05.720552 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6a72b367-b3ba-40c4-a648-fe33939f87cf tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92/os-volume_attachments/c9771cbc-b256-4fe5-8a3e-1170316ce7d8" status: 202 len: 0 microversion: 2.1 time: 0.393349 May 27 09:47:05.723434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 411/809] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:47:05 2022] DELETE /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92/os-volume_attachments/c9771cbc-b256-4fe5-8a3e-1170316ce7d8 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:47:06.840419 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ee27fb10-16ff-4f73-b79d-7e4458927eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:06.840984 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ee27fb10-16ff-4f73-b79d-7e4458927eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:06.843677 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:06.848859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ee27fb10-16ff-4f73-b79d-7e4458927eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:06.849380 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ee27fb10-16ff-4f73-b79d-7e4458927eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:06.850074 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ee27fb10-16ff-4f73-b79d-7e4458927eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:06.850558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ee27fb10-16ff-4f73-b79d-7e4458927eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:06.876898 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ee27fb10-16ff-4f73-b79d-7e4458927eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:47:07.455666 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ee27fb10-16ff-4f73-b79d-7e4458927eeb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 204 len: 0 microversion: 2.1 time: 0.618831 May 27 09:47:07.456435 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 399/810] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:47:06 2022] DELETE /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:47:07.466472 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-465e72ad-b16e-4aa5-95dd-f4b2c35857a0 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:07.467988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-465e72ad-b16e-4aa5-95dd-f4b2c35857a0 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:07.474171 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-465e72ad-b16e-4aa5-95dd-f4b2c35857a0 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:07.474677 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-465e72ad-b16e-4aa5-95dd-f4b2c35857a0 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:07.475440 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-465e72ad-b16e-4aa5-95dd-f4b2c35857a0 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:07.475870 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-465e72ad-b16e-4aa5-95dd-f4b2c35857a0 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:07.609391 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-465e72ad-b16e-4aa5-95dd-f4b2c35857a0 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:07.617062 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-465e72ad-b16e-4aa5-95dd-f4b2c35857a0 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1512 microversion: 2.1 time: 0.155854 May 27 09:47:07.617632 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 412/811] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:07 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:08.635298 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-410c4aba-3d24-4c3c-85ac-8d3035e1845d tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:08.635929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-410c4aba-3d24-4c3c-85ac-8d3035e1845d tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:08.643010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-410c4aba-3d24-4c3c-85ac-8d3035e1845d tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:08.643435 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-410c4aba-3d24-4c3c-85ac-8d3035e1845d tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:08.644293 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-410c4aba-3d24-4c3c-85ac-8d3035e1845d tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:08.644732 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-410c4aba-3d24-4c3c-85ac-8d3035e1845d tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:08.782473 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-410c4aba-3d24-4c3c-85ac-8d3035e1845d tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:08.790285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-410c4aba-3d24-4c3c-85ac-8d3035e1845d tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1512 microversion: 2.1 time: 0.159438 May 27 09:47:08.790867 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 400/812] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:08 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:09.807854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-58561de0-c0ea-49a9-a3d5-d24cdc1616f6 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:09.808472 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-58561de0-c0ea-49a9-a3d5-d24cdc1616f6 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:09.815318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-58561de0-c0ea-49a9-a3d5-d24cdc1616f6 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:09.815759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-58561de0-c0ea-49a9-a3d5-d24cdc1616f6 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:09.816882 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-58561de0-c0ea-49a9-a3d5-d24cdc1616f6 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:09.817012 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-58561de0-c0ea-49a9-a3d5-d24cdc1616f6 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:10.014492 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-58561de0-c0ea-49a9-a3d5-d24cdc1616f6 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:10.022384 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-58561de0-c0ea-49a9-a3d5-d24cdc1616f6 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1512 microversion: 2.1 time: 0.218275 May 27 09:47:10.023232 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 413/813] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:09 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1512 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:10.233460 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-5c3dbe09-06cd-47ad-80ca-e338ab6bd186 req-f6b3c912-76d3-4224-962a-f4681e3981de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e594966b-9aeb-4686-99df-3bff0a8f1c92", "name": "network-vif-deleted", "tag": "78434af1-6c26-4b3b-a4b3-775e641ef393"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:10.242100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-5c3dbe09-06cd-47ad-80ca-e338ab6bd186 req-f6b3c912-76d3-4224-962a-f4681e3981de service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:10.242503 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-5c3dbe09-06cd-47ad-80ca-e338ab6bd186 req-f6b3c912-76d3-4224-962a-f4681e3981de service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:10.254125 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-5c3dbe09-06cd-47ad-80ca-e338ab6bd186 req-f6b3c912-76d3-4224-962a-f4681e3981de service nova] Creating event network-vif-deleted:78434af1-6c26-4b3b-a4b3-775e641ef393 for instance e594966b-9aeb-4686-99df-3bff0a8f1c92 on hv-cinder-82549 May 27 09:47:10.259169 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-5c3dbe09-06cd-47ad-80ca-e338ab6bd186 req-f6b3c912-76d3-4224-962a-f4681e3981de service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029344 May 27 09:47:10.259771 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 401/814] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:11.039451 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:11.040058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:11.047442 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:11.047928 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:11.048682 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:11.049113 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:11.081313 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:11.081760 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:11.082280 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lazy-loading 'fault' on Instance uuid e594966b-9aeb-4686-99df-3bff0a8f1c92 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:47:11.122859 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:11.130902 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7ecdb7ae-e41b-4d5a-adb2-c41cdd37edd5 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 200 len: 1307 microversion: 2.1 time: 0.095407 May 27 09:47:11.131458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 414/815] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:11 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:12.149181 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d65c1413-2503-495b-9ef1-13299d48e263 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:12.149899 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d65c1413-2503-495b-9ef1-13299d48e263 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: e594966b-9aeb-4686-99df-3bff0a8f1c92] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:12.156454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d65c1413-2503-495b-9ef1-13299d48e263 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:12.159561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d65c1413-2503-495b-9ef1-13299d48e263 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:12.159561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d65c1413-2503-495b-9ef1-13299d48e263 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:12.159561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d65c1413-2503-495b-9ef1-13299d48e263 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:12.172574 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-d65c1413-2503-495b-9ef1-13299d48e263 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] HTTP exception thrown: Instance e594966b-9aeb-4686-99df-3bff0a8f1c92 could not be found. May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d65c1413-2503-495b-9ef1-13299d48e263 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Request method failure captured: May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 HTTP/1.1 May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJ3JNwslWG80nNSm7wr5k57pX5GXoRU0iCxyH6mOGOYIonHnysVDodnkolmctsPr6UBEQzrOznT6-lw1sO6xbj_N2gL9c1Khw7J-uzz35RepqgyllVEgHn6WGQUSP7gnYqx9QwpzhkF5yGORuMQehfC_F0RBLuDtuH1QKVa2qwNbm3k May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 1c6cf7096e63465d8e861f9f82b21e2b May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-VolumesSnapshotTestJSON-651826067 May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:47:12.174316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1c6cf7096e63465d8e861f9f82b21e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c6cf7096e63465d8e861f9f82b21e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c6cf7096e63465d8e861f9f82b21e2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1c6cf7096e63465d8e861f9f82b21e2b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-VolumesSnapshotTestJSON-651826067 May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 1c6cf7096e63465d8e861f9f82b21e2b May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-651826067 May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-VolumesSnapshotTestJSON-651826067-project May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 09e3e81754b345009e5d2b976ca321f4 May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-VolumesSnapshotTestJSON-651826067-project May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance e594966b-9aeb-4686-99df-3bff0a8f1c92 could not be found. May 27 09:47:12.175966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': 'e594966b-9aeb-4686-99df-3bff0a8f1c92'} May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e594966b-9aeb-4686-99df-3bff0a8f1c92 could not be found. May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:47:12.177022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e594966b-9aeb-4686-99df-3bff0a8f1c92 could not be found. May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e594966b-9aeb-4686-99df-3bff0a8f1c92 could not be found. May 27 09:47:12.178543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:47:12.180245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d65c1413-2503-495b-9ef1-13299d48e263 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Returning 404 to user: Instance e594966b-9aeb-4686-99df-3bff0a8f1c92 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:47:12.180245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d65c1413-2503-495b-9ef1-13299d48e263 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92" status: 404 len: 111 microversion: 2.1 time: 0.031217 May 27 09:47:12.180245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 402/816] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:12 2022] GET /compute/v2.1/servers/e594966b-9aeb-4686-99df-3bff0a8f1c92 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:47:28.041305 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1852984634", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "networks": [{"uuid": "de0d4211-2d49-40de-aa12-f8cd932f5969"}]}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:28.048625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=17 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:28.049329 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=28,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:28.095396 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.network.neutron [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] validate_networks() for [('de0d4211-2d49-40de-aa12-f8cd932f5969', None, None, None, None, None)] {{(pid=124829) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:47:28.461230 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Flavor limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:47:28.461649 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Image limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:47:28.462119 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Flavor pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:47:28.462568 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Image pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:47:28.462975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:47:28.471979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:28.472418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.474052 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:28.474508 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:28.493368 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Getting quotas for project 1c6cf7096e63465d8e861f9f82b21e2b. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:47:28.497651 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Getting quotas for user 09e3e81754b345009e5d2b976ca321f4 and project 1c6cf7096e63465d8e861f9f82b21e2b. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:47:28.508759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Going to run 1 instances... {{(pid=124829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:47:28.511071 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:47:28.640197 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2fbf480c-f349-4a36-9b2f-ea5fea5a9ffe tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602653 May 27 09:47:28.640891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 415/817] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:47:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:47:28.655524 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-aba6837c-d977-4484-8066-1f31d0907677 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:28.658237 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-aba6837c-d977-4484-8066-1f31d0907677 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:28.661238 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:28.663555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:28.756709 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-aba6837c-d977-4484-8066-1f31d0907677 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:28.764771 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-aba6837c-d977-4484-8066-1f31d0907677 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1219 microversion: 2.1 time: 0.116815 May 27 09:47:28.765561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 403/818] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:28 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1219 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:29.781952 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4258514b-5cb1-4b99-aebe-0eff2b0250da tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:29.782577 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4258514b-5cb1-4b99-aebe-0eff2b0250da tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:29.789954 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4258514b-5cb1-4b99-aebe-0eff2b0250da tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:29.791665 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4258514b-5cb1-4b99-aebe-0eff2b0250da tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:29.791665 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4258514b-5cb1-4b99-aebe-0eff2b0250da tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:29.791944 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4258514b-5cb1-4b99-aebe-0eff2b0250da tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:29.854869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4258514b-5cb1-4b99-aebe-0eff2b0250da tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:29.863806 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4258514b-5cb1-4b99-aebe-0eff2b0250da tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1223 microversion: 2.1 time: 0.085692 May 27 09:47:29.864419 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 416/819] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:29 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:30.882171 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4ce0ba2d-8b09-4077-8d45-8bfe83def423 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:30.882890 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4ce0ba2d-8b09-4077-8d45-8bfe83def423 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:30.898313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4ce0ba2d-8b09-4077-8d45-8bfe83def423 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:30.898900 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4ce0ba2d-8b09-4077-8d45-8bfe83def423 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:30.899829 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4ce0ba2d-8b09-4077-8d45-8bfe83def423 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:30.900188 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4ce0ba2d-8b09-4077-8d45-8bfe83def423 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:30.977412 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4ce0ba2d-8b09-4077-8d45-8bfe83def423 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:30.987849 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4ce0ba2d-8b09-4077-8d45-8bfe83def423 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1279 microversion: 2.1 time: 0.110451 May 27 09:47:30.988681 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 404/820] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:30 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1279 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:32.010382 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ab07a65c-aded-412b-98ee-98e1cbda3841 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:32.011027 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ab07a65c-aded-412b-98ee-98e1cbda3841 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:32.017921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ab07a65c-aded-412b-98ee-98e1cbda3841 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:32.032554 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ab07a65c-aded-412b-98ee-98e1cbda3841 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:32.032554 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ab07a65c-aded-412b-98ee-98e1cbda3841 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:32.032554 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ab07a65c-aded-412b-98ee-98e1cbda3841 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:32.243232 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ab07a65c-aded-412b-98ee-98e1cbda3841 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:32.251252 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ab07a65c-aded-412b-98ee-98e1cbda3841 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1319 microversion: 2.1 time: 0.244779 May 27 09:47:32.251942 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 417/821] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:32 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:32.975805 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-cc554e02-b5dc-42e4-a3cf-30c8655c8553 req-086faead-bff5-458a-9a44-a2125fe2c660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ba225fa-de0f-4e55-a079-d6ed68335160", "tag": "60cb695d-d625-4c87-a3ef-001462173f12"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:32.987811 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-cc554e02-b5dc-42e4-a3cf-30c8655c8553 req-086faead-bff5-458a-9a44-a2125fe2c660 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:32.988565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-cc554e02-b5dc-42e4-a3cf-30c8655c8553 req-086faead-bff5-458a-9a44-a2125fe2c660 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:33.003866 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-cc554e02-b5dc-42e4-a3cf-30c8655c8553 req-086faead-bff5-458a-9a44-a2125fe2c660 service nova] Creating event network-changed:60cb695d-d625-4c87-a3ef-001462173f12 for instance 8ba225fa-de0f-4e55-a079-d6ed68335160 on hv-cinder-82549 May 27 09:47:33.009115 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-cc554e02-b5dc-42e4-a3cf-30c8655c8553 req-086faead-bff5-458a-9a44-a2125fe2c660 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038675 May 27 09:47:33.009711 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 405/822] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:33.269127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2a2b224f-f270-4bbf-aea0-a8f3465abf26 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:33.269753 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2a2b224f-f270-4bbf-aea0-a8f3465abf26 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:33.276546 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2a2b224f-f270-4bbf-aea0-a8f3465abf26 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:33.276973 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2a2b224f-f270-4bbf-aea0-a8f3465abf26 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:33.277739 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2a2b224f-f270-4bbf-aea0-a8f3465abf26 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:33.278172 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2a2b224f-f270-4bbf-aea0-a8f3465abf26 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:33.519529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2a2b224f-f270-4bbf-aea0-a8f3465abf26 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:33.529892 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2a2b224f-f270-4bbf-aea0-a8f3465abf26 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1319 microversion: 2.1 time: 0.264833 May 27 09:47:33.530589 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 418/823] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:33 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:34.548697 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-67a5ad7f-1a17-403e-adad-969ab9a7ed73 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:34.549364 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-67a5ad7f-1a17-403e-adad-969ab9a7ed73 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:34.556793 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-67a5ad7f-1a17-403e-adad-969ab9a7ed73 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:34.557326 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-67a5ad7f-1a17-403e-adad-969ab9a7ed73 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:34.558098 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-67a5ad7f-1a17-403e-adad-969ab9a7ed73 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:34.558557 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-67a5ad7f-1a17-403e-adad-969ab9a7ed73 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:34.690690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-67a5ad7f-1a17-403e-adad-969ab9a7ed73 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:34.698353 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-67a5ad7f-1a17-403e-adad-969ab9a7ed73 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1319 microversion: 2.1 time: 0.154377 May 27 09:47:34.698929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 406/824] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:34 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:35.715598 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d9406a1e-5cd3-47f5-be53-31d24493ad92 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:35.716218 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d9406a1e-5cd3-47f5-be53-31d24493ad92 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:35.722860 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d9406a1e-5cd3-47f5-be53-31d24493ad92 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:35.723312 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d9406a1e-5cd3-47f5-be53-31d24493ad92 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:35.724080 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d9406a1e-5cd3-47f5-be53-31d24493ad92 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:35.724514 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d9406a1e-5cd3-47f5-be53-31d24493ad92 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:35.859331 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d9406a1e-5cd3-47f5-be53-31d24493ad92 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:35.867324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d9406a1e-5cd3-47f5-be53-31d24493ad92 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1319 microversion: 2.1 time: 0.155603 May 27 09:47:35.867890 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 419/825] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:35 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:36.884257 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4d29c34c-3dce-4115-9d5b-30bbd3ad98cb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:36.885478 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4d29c34c-3dce-4115-9d5b-30bbd3ad98cb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:36.892663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d29c34c-3dce-4115-9d5b-30bbd3ad98cb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:36.893212 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d29c34c-3dce-4115-9d5b-30bbd3ad98cb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:36.893899 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d29c34c-3dce-4115-9d5b-30bbd3ad98cb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:36.894372 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4d29c34c-3dce-4115-9d5b-30bbd3ad98cb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:37.028052 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4d29c34c-3dce-4115-9d5b-30bbd3ad98cb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:37.035848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4d29c34c-3dce-4115-9d5b-30bbd3ad98cb tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1319 microversion: 2.1 time: 0.155974 May 27 09:47:37.036505 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 407/826] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:36 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:38.053127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-04247e4d-051e-4c5d-8ab9-f4f0fe47b1fa tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:38.053772 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-04247e4d-051e-4c5d-8ab9-f4f0fe47b1fa tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:38.061059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-04247e4d-051e-4c5d-8ab9-f4f0fe47b1fa tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:38.061512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-04247e4d-051e-4c5d-8ab9-f4f0fe47b1fa tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:38.062341 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-04247e4d-051e-4c5d-8ab9-f4f0fe47b1fa tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:38.062784 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-04247e4d-051e-4c5d-8ab9-f4f0fe47b1fa tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:38.203646 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-04247e4d-051e-4c5d-8ab9-f4f0fe47b1fa tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:38.209309 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-04247e4d-051e-4c5d-8ab9-f4f0fe47b1fa tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1319 microversion: 2.1 time: 0.160077 May 27 09:47:38.209886 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 420/827] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:38 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:38.685676 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-55a70daa-ae93-4616-b091-82b558ff9847 req-9050e873-b224-41bb-ba1b-06907b5338a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba225fa-de0f-4e55-a079-d6ed68335160", "name": "network-vif-plugged", "status": "completed", "tag": "60cb695d-d625-4c87-a3ef-001462173f12"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:38.694805 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-55a70daa-ae93-4616-b091-82b558ff9847 req-9050e873-b224-41bb-ba1b-06907b5338a7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:38.697123 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-55a70daa-ae93-4616-b091-82b558ff9847 req-9050e873-b224-41bb-ba1b-06907b5338a7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:38.707208 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-55a70daa-ae93-4616-b091-82b558ff9847 req-9050e873-b224-41bb-ba1b-06907b5338a7 service nova] Creating event network-vif-plugged:60cb695d-d625-4c87-a3ef-001462173f12 for instance 8ba225fa-de0f-4e55-a079-d6ed68335160 on hv-cinder-82549 May 27 09:47:38.715673 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-55a70daa-ae93-4616-b091-82b558ff9847 req-9050e873-b224-41bb-ba1b-06907b5338a7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033588 May 27 09:47:38.716492 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 408/828] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:47:39.226343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6ad9756b-ee36-4a48-aa00-678704893466 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:39.227037 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6ad9756b-ee36-4a48-aa00-678704893466 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:39.228879 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:39.229554 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=6 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:39.235067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6ad9756b-ee36-4a48-aa00-678704893466 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:39.235523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6ad9756b-ee36-4a48-aa00-678704893466 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:39.236295 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6ad9756b-ee36-4a48-aa00-678704893466 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:39.236733 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6ad9756b-ee36-4a48-aa00-678704893466 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:39.373689 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-6ad9756b-ee36-4a48-aa00-678704893466 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:39.381435 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6ad9756b-ee36-4a48-aa00-678704893466 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1319 microversion: 2.1 time: 0.159161 May 27 09:47:39.382070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 421/829] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:39 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:40.395770 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:47:40.400976 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ef9589a0-299e-4198-8aa7-ce16cf44983b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:40.401748 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ef9589a0-299e-4198-8aa7-ce16cf44983b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:40.408002 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ef9589a0-299e-4198-8aa7-ce16cf44983b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:40.408451 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ef9589a0-299e-4198-8aa7-ce16cf44983b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:40.409277 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ef9589a0-299e-4198-8aa7-ce16cf44983b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:40.409713 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ef9589a0-299e-4198-8aa7-ce16cf44983b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:40.544828 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ef9589a0-299e-4198-8aa7-ce16cf44983b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:40.553162 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ef9589a0-299e-4198-8aa7-ce16cf44983b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1319 microversion: 2.1 time: 0.158262 May 27 09:47:40.553750 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 409/830] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:40 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:41.570681 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-cee2eed6-10df-4608-8805-a24737c05912 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:47:41.571938 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-cee2eed6-10df-4608-8805-a24737c05912 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:41.578908 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cee2eed6-10df-4608-8805-a24737c05912 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:41.581895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cee2eed6-10df-4608-8805-a24737c05912 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:41.581895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cee2eed6-10df-4608-8805-a24737c05912 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:41.581895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cee2eed6-10df-4608-8805-a24737c05912 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:41.722701 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-cee2eed6-10df-4608-8805-a24737c05912 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:47:41.731868 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-cee2eed6-10df-4608-8805-a24737c05912 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1507 microversion: 2.1 time: 0.165201 May 27 09:47:41.732430 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 422/831] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:47:41 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:47:41.753580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f9b7b661-2f22-46f6-9ed5-cf0045de781e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33fa4548-6528-4e1a-8110-8cfebb71e6ff", "device": "/dev/sdb"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:47:41.754818 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f9b7b661-2f22-46f6-9ed5-cf0045de781e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:47:41.761352 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f9b7b661-2f22-46f6-9ed5-cf0045de781e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:41.761801 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f9b7b661-2f22-46f6-9ed5-cf0045de781e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:41.762591 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f9b7b661-2f22-46f6-9ed5-cf0045de781e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:47:41.763073 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f9b7b661-2f22-46f6-9ed5-cf0045de781e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:47:42.762331 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f9b7b661-2f22-46f6-9ed5-cf0045de781e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "POST /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.012448 May 27 09:47:42.769158 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 410/832] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:47:41 2022] POST /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160/os-volume_attachments => generated 194 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:48:10.109010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:48:10.109717 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 09:48:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:48:12.380302 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-de4de650-70d1-4a7c-84d5-be9271d7920b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:12.390413 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-de4de650-70d1-4a7c-84d5-be9271d7920b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:12.390413 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:12.390413 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=44 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:12.390413 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-de4de650-70d1-4a7c-84d5-be9271d7920b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:12.390413 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-de4de650-70d1-4a7c-84d5-be9271d7920b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:12.390889 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-de4de650-70d1-4a7c-84d5-be9271d7920b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:12.391124 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-de4de650-70d1-4a7c-84d5-be9271d7920b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:12.471879 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-de4de650-70d1-4a7c-84d5-be9271d7920b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lazy-loading 'services' on Instance uuid 8ba225fa-de0f-4e55-a079-d6ed68335160 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:48:12.749696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-de4de650-70d1-4a7c-84d5-be9271d7920b tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160/os-volume_attachments/33fa4548-6528-4e1a-8110-8cfebb71e6ff" status: 202 len: 0 microversion: 2.1 time: 0.373429 May 27 09:48:12.751726 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 423/833] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:48:12 2022] DELETE /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160/os-volume_attachments/33fa4548-6528-4e1a-8110-8cfebb71e6ff => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:48:13.872584 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=18 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:13.873393 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:13.877768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e0e10153-b782-4092-8d16-1388a5729944 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:13.878429 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e0e10153-b782-4092-8d16-1388a5729944 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:13.885255 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0e10153-b782-4092-8d16-1388a5729944 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:13.885709 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0e10153-b782-4092-8d16-1388a5729944 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:13.886534 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0e10153-b782-4092-8d16-1388a5729944 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:13.886978 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0e10153-b782-4092-8d16-1388a5729944 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:13.919110 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e0e10153-b782-4092-8d16-1388a5729944 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:48:14.296922 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e0e10153-b782-4092-8d16-1388a5729944 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 204 len: 0 microversion: 2.1 time: 0.425476 May 27 09:48:14.297443 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 411/834] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:48:13 2022] DELETE /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:48:14.308037 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0f6d09c6-472f-44c0-99fd-c1dd45e8ebd3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:14.308929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0f6d09c6-472f-44c0-99fd-c1dd45e8ebd3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:14.315287 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0f6d09c6-472f-44c0-99fd-c1dd45e8ebd3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:14.315767 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0f6d09c6-472f-44c0-99fd-c1dd45e8ebd3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:14.316525 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0f6d09c6-472f-44c0-99fd-c1dd45e8ebd3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:14.316960 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0f6d09c6-472f-44c0-99fd-c1dd45e8ebd3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:14.449867 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0f6d09c6-472f-44c0-99fd-c1dd45e8ebd3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:14.457510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0f6d09c6-472f-44c0-99fd-c1dd45e8ebd3 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1513 microversion: 2.1 time: 0.155394 May 27 09:48:14.458081 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 424/835] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:48:14 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:15.475365 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f8cb52df-bb29-4c43-9cde-027a3ad20ef9 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:15.476005 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f8cb52df-bb29-4c43-9cde-027a3ad20ef9 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:15.483016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f8cb52df-bb29-4c43-9cde-027a3ad20ef9 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:15.483468 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f8cb52df-bb29-4c43-9cde-027a3ad20ef9 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:15.484238 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f8cb52df-bb29-4c43-9cde-027a3ad20ef9 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:15.484746 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f8cb52df-bb29-4c43-9cde-027a3ad20ef9 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:15.619753 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f8cb52df-bb29-4c43-9cde-027a3ad20ef9 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:15.627280 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f8cb52df-bb29-4c43-9cde-027a3ad20ef9 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1513 microversion: 2.1 time: 0.156267 May 27 09:48:15.629050 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 412/836] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:48:15 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:16.644990 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b83e7af3-a90d-40bb-b22f-dc817887494e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:16.645675 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b83e7af3-a90d-40bb-b22f-dc817887494e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:16.658891 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b83e7af3-a90d-40bb-b22f-dc817887494e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:16.658891 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b83e7af3-a90d-40bb-b22f-dc817887494e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:16.658891 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b83e7af3-a90d-40bb-b22f-dc817887494e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:16.658891 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b83e7af3-a90d-40bb-b22f-dc817887494e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:16.724716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b83e7af3-a90d-40bb-b22f-dc817887494e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e3e81754b345009e5d2b976ca321f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c6cf7096e63465d8e861f9f82b21e2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:16.734229 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b83e7af3-a90d-40bb-b22f-dc817887494e tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 200 len: 1471 microversion: 2.1 time: 0.093230 May 27 09:48:16.734893 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 413/837] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:48:16 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:48:16.778411 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-da4cb524-bd7f-4064-a0f5-42b6a5ff3885 req-57c4f403-915f-4059-a1d9-1797009043ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ba225fa-de0f-4e55-a079-d6ed68335160", "name": "network-vif-deleted", "tag": "60cb695d-d625-4c87-a3ef-001462173f12"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:16.786707 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-da4cb524-bd7f-4064-a0f5-42b6a5ff3885 req-57c4f403-915f-4059-a1d9-1797009043ed service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:16.787418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-da4cb524-bd7f-4064-a0f5-42b6a5ff3885 req-57c4f403-915f-4059-a1d9-1797009043ed service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:16.798914 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-da4cb524-bd7f-4064-a0f5-42b6a5ff3885 req-57c4f403-915f-4059-a1d9-1797009043ed service nova] Creating event network-vif-deleted:60cb695d-d625-4c87-a3ef-001462173f12 for instance 8ba225fa-de0f-4e55-a079-d6ed68335160 on hv-cinder-82549 May 27 09:48:16.803961 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-da4cb524-bd7f-4064-a0f5-42b6a5ff3885 req-57c4f403-915f-4059-a1d9-1797009043ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210021 May 27 09:48:16.804605 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 425/838] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:48:17.752120 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f0245b6c-107e-40a4-b68e-c481d5a68586 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:17.752771 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f0245b6c-107e-40a4-b68e-c481d5a68586 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] [instance: 8ba225fa-de0f-4e55-a079-d6ed68335160] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:17.759616 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f0245b6c-107e-40a4-b68e-c481d5a68586 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:17.760130 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f0245b6c-107e-40a4-b68e-c481d5a68586 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:17.760907 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f0245b6c-107e-40a4-b68e-c481d5a68586 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:17.761342 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f0245b6c-107e-40a4-b68e-c481d5a68586 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:17.775762 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-f0245b6c-107e-40a4-b68e-c481d5a68586 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] HTTP exception thrown: Instance 8ba225fa-de0f-4e55-a079-d6ed68335160 could not be found. May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f0245b6c-107e-40a4-b68e-c481d5a68586 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Request method failure captured: May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 HTTP/1.1 May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJ3JNwslWG80nNSm7wr5k57pX5GXoRU0iCxyH6mOGOYIonHnysVDodnkolmctsPr6UBEQzrOznT6-lw1sO6xbj_N2gL9c1Khw7J-uzz35RepqgyllVEgHn6WGQUSP7gnYqx9QwpzhkF5yGORuMQehfC_F0RBLuDtuH1QKVa2qwNbm3k May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 1c6cf7096e63465d8e861f9f82b21e2b May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-VolumesSnapshotTestJSON-651826067 May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:48:17.777485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1c6cf7096e63465d8e861f9f82b21e2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c6cf7096e63465d8e861f9f82b21e2b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1c6cf7096e63465d8e861f9f82b21e2b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1c6cf7096e63465d8e861f9f82b21e2b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-VolumesSnapshotTestJSON-651826067 May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 1c6cf7096e63465d8e861f9f82b21e2b May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-651826067 May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-VolumesSnapshotTestJSON-651826067-project May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 09e3e81754b345009e5d2b976ca321f4 May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-VolumesSnapshotTestJSON-651826067-project May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 8ba225fa-de0f-4e55-a079-d6ed68335160 could not be found. May 27 09:48:17.792420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '8ba225fa-de0f-4e55-a079-d6ed68335160'} May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ba225fa-de0f-4e55-a079-d6ed68335160 could not be found. May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:48:17.793285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ba225fa-de0f-4e55-a079-d6ed68335160 could not be found. May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ba225fa-de0f-4e55-a079-d6ed68335160 could not be found. May 27 09:48:17.794696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:48:17.796067 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f0245b6c-107e-40a4-b68e-c481d5a68586 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] Returning 404 to user: Instance 8ba225fa-de0f-4e55-a079-d6ed68335160 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:48:17.796067 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f0245b6c-107e-40a4-b68e-c481d5a68586 tempest-VolumesSnapshotTestJSON-651826067 tempest-VolumesSnapshotTestJSON-651826067-project] 10.222.0.48 "GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160" status: 404 len: 111 microversion: 2.1 time: 0.031255 May 27 09:48:17.796067 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 414/839] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:48:17 2022] GET /compute/v2.1/servers/8ba225fa-de0f-4e55-a079-d6ed68335160 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:48:33.408219 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=6 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:33.408962 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:33.413007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6f10a475-4586-4179-9601-b6797a0248e9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:33.413583 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6f10a475-4586-4179-9601-b6797a0248e9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:33.419647 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f10a475-4586-4179-9601-b6797a0248e9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:33.420089 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f10a475-4586-4179-9601-b6797a0248e9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:33.421092 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f10a475-4586-4179-9601-b6797a0248e9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:33.421523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f10a475-4586-4179-9601-b6797a0248e9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:33.445905 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6f10a475-4586-4179-9601-b6797a0248e9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/ips" status: 200 len: 150 microversion: 2.1 time: 0.039306 May 27 09:48:33.446504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 426/840] 10.222.0.48 () {58 vars in 1247 bytes} [Fri May 27 09:48:33 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:48:40.648575 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1a1d69f8-dbbc-4f49-a4fc-e7aa2a9fa6cd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:40.649898 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1a1d69f8-dbbc-4f49-a4fc-e7aa2a9fa6cd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:40.652301 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:40.652936 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:40.657658 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a1d69f8-dbbc-4f49-a4fc-e7aa2a9fa6cd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:40.658098 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a1d69f8-dbbc-4f49-a4fc-e7aa2a9fa6cd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:40.658905 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a1d69f8-dbbc-4f49-a4fc-e7aa2a9fa6cd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:40.659334 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a1d69f8-dbbc-4f49-a4fc-e7aa2a9fa6cd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:42.144010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1a1d69f8-dbbc-4f49-a4fc-e7aa2a9fa6cd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.499312 May 27 09:48:42.144776 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 415/841] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:48:40 2022] POST /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-volume_attachments => generated 194 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:48:50.736212 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1a1beac9-4cbe-4f58-8a7b-9dd41c8fe160 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: .version_select at 0x7fbe322aa0d0>, body: {"keypair": {"name": "tempest-keypair-352596151", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoUUCII7O6pNRwr6j+XVhGQITVHU9FjHNuk0uAZVTK+BWwuR0VcAAY29hyltFN4OKT4GiM9/7TgGwhfz/zXV86tr5dssma9QIUQkAsqSszmzfRZ6VZ8zdSy2xRPd0tgSA=="}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:50.751633 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-1a1beac9-4cbe-4f58-8a7b-9dd41c8fe160 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for project 1b2ae84b95ae44d18119450b94735f03. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:48:50.755576 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-1a1beac9-4cbe-4f58-8a7b-9dd41c8fe160 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for user 6772c708b48b404bb9f8794142ec6060 and project 1b2ae84b95ae44d18119450b94735f03. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:48:50.900821 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1a1beac9-4cbe-4f58-8a7b-9dd41c8fe160 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168483 May 27 09:48:50.901420 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 427/842] 10.222.0.48 () {60 vars in 1158 bytes} [Fri May 27 09:48:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:48:54.048345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:54.049315 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:48:54.054729 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-789972395", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "924af2e1-0920-4407-a4e8-e35b1f67efeb"}], "security_groups": [{"name": "tempest-securitygroup--1255878908"}], "key_name": "tempest-keypair-352596151", "user_data": "}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:54.164523 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] validate_networks() for [('924af2e1-0920-4407-a4e8-e35b1f67efeb', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:48:54.558231 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:48:54.558664 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:48:54.559140 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:48:54.559552 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:48:54.560033 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:48:54.569737 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:54.570213 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:54.571182 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:54.571565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:54.589920 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for project 1b2ae84b95ae44d18119450b94735f03. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:48:54.594565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for user 6772c708b48b404bb9f8794142ec6060 and project 1b2ae84b95ae44d18119450b94735f03. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:48:54.606329 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:48:54.609501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:48:54.765681 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-af0ad390-a8ce-47e5-8c29-94a936951069 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.719023 May 27 09:48:54.766416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 416/843] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:48:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:48:54.776953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-25c36046-8af2-442e-bc58-b87ac357cedc tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:54.777687 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-25c36046-8af2-442e-bc58-b87ac357cedc tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:54.834839 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-25c36046-8af2-442e-bc58-b87ac357cedc tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:54.844498 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-25c36046-8af2-442e-bc58-b87ac357cedc tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1240 microversion: 2.1 time: 0.071317 May 27 09:48:54.845284 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 428/844] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:48:54 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:55.863110 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-38fedfcc-1f3e-4256-aa9d-89fcad06c005 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:55.863720 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-38fedfcc-1f3e-4256-aa9d-89fcad06c005 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:55.923210 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-38fedfcc-1f3e-4256-aa9d-89fcad06c005 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:55.929960 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-38fedfcc-1f3e-4256-aa9d-89fcad06c005 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1240 microversion: 2.1 time: 0.071697 May 27 09:48:55.930572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 417/845] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:48:55 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:56.948896 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-dc4c4920-eaf0-4bf8-8d78-792ed064b223 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:56.949594 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-dc4c4920-eaf0-4bf8-8d78-792ed064b223 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:56.957419 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dc4c4920-eaf0-4bf8-8d78-792ed064b223 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:56.957987 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dc4c4920-eaf0-4bf8-8d78-792ed064b223 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:56.958871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dc4c4920-eaf0-4bf8-8d78-792ed064b223 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:56.959637 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dc4c4920-eaf0-4bf8-8d78-792ed064b223 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:57.033121 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-dc4c4920-eaf0-4bf8-8d78-792ed064b223 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:57.041264 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-dc4c4920-eaf0-4bf8-8d78-792ed064b223 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1292 microversion: 2.1 time: 0.096755 May 27 09:48:57.041845 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 429/846] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:48:56 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:58.060906 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-85f0418e-9a07-4dd3-9c52-af344182bd1d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:58.061457 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-85f0418e-9a07-4dd3-9c52-af344182bd1d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:58.069237 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-85f0418e-9a07-4dd3-9c52-af344182bd1d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:58.069717 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-85f0418e-9a07-4dd3-9c52-af344182bd1d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:58.070643 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-85f0418e-9a07-4dd3-9c52-af344182bd1d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:58.071074 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-85f0418e-9a07-4dd3-9c52-af344182bd1d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:58.156793 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-85f0418e-9a07-4dd3-9c52-af344182bd1d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:58.169634 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-85f0418e-9a07-4dd3-9c52-af344182bd1d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1298 microversion: 2.1 time: 0.113182 May 27 09:48:58.176664 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 418/847] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:48:58 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:59.189991 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-76c2b0c2-869c-47b6-a5fc-43256a7804bf tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:48:59.190813 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-76c2b0c2-869c-47b6-a5fc-43256a7804bf tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:48:59.198866 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-76c2b0c2-869c-47b6-a5fc-43256a7804bf tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:59.199630 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-76c2b0c2-869c-47b6-a5fc-43256a7804bf tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:59.200976 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-76c2b0c2-869c-47b6-a5fc-43256a7804bf tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:59.201711 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-76c2b0c2-869c-47b6-a5fc-43256a7804bf tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:59.393078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-76c2b0c2-869c-47b6-a5fc-43256a7804bf tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:48:59.400926 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-76c2b0c2-869c-47b6-a5fc-43256a7804bf tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1366 microversion: 2.1 time: 0.215835 May 27 09:48:59.401473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 430/848] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:48:59 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:48:59.503235 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-2cd0d0eb-5d24-44eb-9c3f-1c2041b4eaac req-ca7e9170-4bb3-4801-8061-a334b1b3e942 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a4f200-7733-45c0-8799-a97b6779ffa4", "tag": "4644529d-26fb-4b81-9f43-8bb9ee098aa5"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:48:59.513987 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-2cd0d0eb-5d24-44eb-9c3f-1c2041b4eaac req-ca7e9170-4bb3-4801-8061-a334b1b3e942 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:48:59.518599 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-2cd0d0eb-5d24-44eb-9c3f-1c2041b4eaac req-ca7e9170-4bb3-4801-8061-a334b1b3e942 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:48:59.526293 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-2cd0d0eb-5d24-44eb-9c3f-1c2041b4eaac req-ca7e9170-4bb3-4801-8061-a334b1b3e942 service nova] Creating event network-changed:4644529d-26fb-4b81-9f43-8bb9ee098aa5 for instance 61a4f200-7733-45c0-8799-a97b6779ffa4 on hv-cinder-82549 May 27 09:48:59.533293 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-2cd0d0eb-5d24-44eb-9c3f-1c2041b4eaac req-ca7e9170-4bb3-4801-8061-a334b1b3e942 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033905 May 27 09:48:59.533896 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 419/849] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:00.419101 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-02b20702-5dd7-443b-bffc-d9288fbaf109 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:00.419731 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-02b20702-5dd7-443b-bffc-d9288fbaf109 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:00.426408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-02b20702-5dd7-443b-bffc-d9288fbaf109 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:00.426860 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-02b20702-5dd7-443b-bffc-d9288fbaf109 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:00.427610 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-02b20702-5dd7-443b-bffc-d9288fbaf109 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:00.428040 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-02b20702-5dd7-443b-bffc-d9288fbaf109 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:00.585722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-02b20702-5dd7-443b-bffc-d9288fbaf109 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:00.594382 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-02b20702-5dd7-443b-bffc-d9288fbaf109 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1366 microversion: 2.1 time: 0.178990 May 27 09:49:00.595266 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 431/850] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:00 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:01.613237 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9eb0b8a3-ba10-4a8d-ac3d-7e18baa5b62f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:01.613975 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9eb0b8a3-ba10-4a8d-ac3d-7e18baa5b62f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:01.620367 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9eb0b8a3-ba10-4a8d-ac3d-7e18baa5b62f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:01.620814 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9eb0b8a3-ba10-4a8d-ac3d-7e18baa5b62f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:01.621584 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9eb0b8a3-ba10-4a8d-ac3d-7e18baa5b62f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:01.622030 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9eb0b8a3-ba10-4a8d-ac3d-7e18baa5b62f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:01.761828 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9eb0b8a3-ba10-4a8d-ac3d-7e18baa5b62f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:01.769578 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9eb0b8a3-ba10-4a8d-ac3d-7e18baa5b62f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1366 microversion: 2.1 time: 0.161027 May 27 09:49:01.770143 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 420/851] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:01 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:02.787457 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c49fe7bd-8580-46e9-a5c3-59de5ebb90c3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:02.788073 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c49fe7bd-8580-46e9-a5c3-59de5ebb90c3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:02.794983 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c49fe7bd-8580-46e9-a5c3-59de5ebb90c3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:02.795753 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c49fe7bd-8580-46e9-a5c3-59de5ebb90c3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:02.796534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c49fe7bd-8580-46e9-a5c3-59de5ebb90c3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:02.796971 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c49fe7bd-8580-46e9-a5c3-59de5ebb90c3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:02.930832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c49fe7bd-8580-46e9-a5c3-59de5ebb90c3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:02.938470 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c49fe7bd-8580-46e9-a5c3-59de5ebb90c3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1366 microversion: 2.1 time: 0.154860 May 27 09:49:02.942712 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 432/852] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:02 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:03.780024 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1283888002", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:03.832230 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] validate_networks() for None {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:49:03.955007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-33168b6f-74e2-4e03-9320-0ae9be37ffd5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:03.955593 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-33168b6f-74e2-4e03-9320-0ae9be37ffd5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:03.962286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33168b6f-74e2-4e03-9320-0ae9be37ffd5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:03.962732 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33168b6f-74e2-4e03-9320-0ae9be37ffd5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:03.963496 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33168b6f-74e2-4e03-9320-0ae9be37ffd5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:03.963924 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-33168b6f-74e2-4e03-9320-0ae9be37ffd5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.099554 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-33168b6f-74e2-4e03-9320-0ae9be37ffd5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:04.104974 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:49:04.105405 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:49:04.105913 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:49:04.106365 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:49:04.107365 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:49:04.107854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-33168b6f-74e2-4e03-9320-0ae9be37ffd5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1366 microversion: 2.1 time: 0.156716 May 27 09:49:04.108512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 433/853] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:03 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:49:04.116663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:04.117117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.117923 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:04.118400 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:04.134951 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Getting quotas for project 2ce16e6ee5e744d882a10a967fe64ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:49:04.139327 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Getting quotas for user a7ec3ba35ee94014aba246c60269bfe1 and project 2ce16e6ee5e744d882a10a967fe64ad2. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:49:04.150320 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:49:04.152595 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:49:04.337474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2730c407-ec0a-4db4-9b53-7a4c898b0a6d tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.561227 May 27 09:49:04.338480 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 421/854] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:49:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:49:04.348743 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ea8920d6-91fd-416b-b67a-2ada7866aa33 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:04.349313 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ea8920d6-91fd-416b-b67a-2ada7866aa33 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:04.405525 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ea8920d6-91fd-416b-b67a-2ada7866aa33 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:04.412180 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ea8920d6-91fd-416b-b67a-2ada7866aa33 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1215 microversion: 2.1 time: 0.067424 May 27 09:49:04.412745 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 434/855] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:04 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1215 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:05.126169 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-24f57c54-c386-4a49-b932-c91e0a33ccf5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:05.126755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-24f57c54-c386-4a49-b932-c91e0a33ccf5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:05.133516 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-24f57c54-c386-4a49-b932-c91e0a33ccf5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:05.133959 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-24f57c54-c386-4a49-b932-c91e0a33ccf5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:05.134760 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-24f57c54-c386-4a49-b932-c91e0a33ccf5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:05.135195 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-24f57c54-c386-4a49-b932-c91e0a33ccf5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:05.274435 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-24f57c54-c386-4a49-b932-c91e0a33ccf5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:05.282354 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-24f57c54-c386-4a49-b932-c91e0a33ccf5 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1366 microversion: 2.1 time: 0.161304 May 27 09:49:05.283036 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 422/856] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:05 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:05.429365 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-83e545cc-54aa-4bbc-98b8-757b19e2d710 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:05.429912 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-83e545cc-54aa-4bbc-98b8-757b19e2d710 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:05.484663 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-83e545cc-54aa-4bbc-98b8-757b19e2d710 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:05.491756 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-83e545cc-54aa-4bbc-98b8-757b19e2d710 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1215 microversion: 2.1 time: 0.066712 May 27 09:49:05.492325 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 435/857] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:05 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1215 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:06.300169 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-adc33c8c-8304-45d1-871f-15183df5316a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:06.300791 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-adc33c8c-8304-45d1-871f-15183df5316a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:06.307667 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-adc33c8c-8304-45d1-871f-15183df5316a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:06.308117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-adc33c8c-8304-45d1-871f-15183df5316a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:06.308919 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-adc33c8c-8304-45d1-871f-15183df5316a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:06.309354 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-adc33c8c-8304-45d1-871f-15183df5316a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:06.445682 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-adc33c8c-8304-45d1-871f-15183df5316a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:06.454700 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-adc33c8c-8304-45d1-871f-15183df5316a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1366 microversion: 2.1 time: 0.158922 May 27 09:49:06.455277 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 423/858] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:06 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:06.508537 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-bcf5b331-f354-47a7-8885-c2a154340048 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:06.509162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-bcf5b331-f354-47a7-8885-c2a154340048 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:06.515730 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bcf5b331-f354-47a7-8885-c2a154340048 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:06.516262 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bcf5b331-f354-47a7-8885-c2a154340048 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:06.517032 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bcf5b331-f354-47a7-8885-c2a154340048 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:06.517473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bcf5b331-f354-47a7-8885-c2a154340048 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:06.580397 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-bcf5b331-f354-47a7-8885-c2a154340048 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:06.588363 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-bcf5b331-f354-47a7-8885-c2a154340048 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1267 microversion: 2.1 time: 0.083619 May 27 09:49:06.588950 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 436/859] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:06 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:07.355724 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-2bd1aa40-679e-4b81-a2c1-9497a38cb65f req-8be67c94-f671-4e8e-af29-dcb35e2ca8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a4f200-7733-45c0-8799-a97b6779ffa4", "name": "network-vif-plugged", "status": "completed", "tag": "4644529d-26fb-4b81-9f43-8bb9ee098aa5"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:07.368846 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-2bd1aa40-679e-4b81-a2c1-9497a38cb65f req-8be67c94-f671-4e8e-af29-dcb35e2ca8be service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:07.369836 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-2bd1aa40-679e-4b81-a2c1-9497a38cb65f req-8be67c94-f671-4e8e-af29-dcb35e2ca8be service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:07.391846 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-2bd1aa40-679e-4b81-a2c1-9497a38cb65f req-8be67c94-f671-4e8e-af29-dcb35e2ca8be service nova] Creating event network-vif-plugged:4644529d-26fb-4b81-9f43-8bb9ee098aa5 for instance 61a4f200-7733-45c0-8799-a97b6779ffa4 on hv-cinder-82549 May 27 09:49:07.400157 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-2bd1aa40-679e-4b81-a2c1-9497a38cb65f req-8be67c94-f671-4e8e-af29-dcb35e2ca8be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218561 May 27 09:49:07.400769 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 424/860] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:07.472871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-44595b45-662e-4c41-bf91-0ff6d606f629 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:07.473665 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-44595b45-662e-4c41-bf91-0ff6d606f629 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:07.480233 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44595b45-662e-4c41-bf91-0ff6d606f629 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:07.485096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44595b45-662e-4c41-bf91-0ff6d606f629 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:07.485096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44595b45-662e-4c41-bf91-0ff6d606f629 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:07.485096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44595b45-662e-4c41-bf91-0ff6d606f629 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:07.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-982789fd-98b8-43e3-a13d-b4d21cb9c4e9 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:07.606830 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-982789fd-98b8-43e3-a13d-b4d21cb9c4e9 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:07.614247 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-982789fd-98b8-43e3-a13d-b4d21cb9c4e9 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:07.614691 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-982789fd-98b8-43e3-a13d-b4d21cb9c4e9 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:07.615501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-982789fd-98b8-43e3-a13d-b4d21cb9c4e9 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:07.615988 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-982789fd-98b8-43e3-a13d-b4d21cb9c4e9 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:07.647096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-44595b45-662e-4c41-bf91-0ff6d606f629 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:07.655465 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-44595b45-662e-4c41-bf91-0ff6d606f629 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1366 microversion: 2.1 time: 0.186725 May 27 09:49:07.656208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 437/861] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:07 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:07.690233 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-982789fd-98b8-43e3-a13d-b4d21cb9c4e9 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:07.697843 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-982789fd-98b8-43e3-a13d-b4d21cb9c4e9 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1273 microversion: 2.1 time: 0.096575 May 27 09:49:07.698449 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 425/862] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:07 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:49:08.672800 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7c408d19-1d89-4be2-88b3-2cba461fe361 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:08.673508 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7c408d19-1d89-4be2-88b3-2cba461fe361 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:08.681423 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7c408d19-1d89-4be2-88b3-2cba461fe361 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:08.682007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7c408d19-1d89-4be2-88b3-2cba461fe361 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:08.685735 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7c408d19-1d89-4be2-88b3-2cba461fe361 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:08.686181 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7c408d19-1d89-4be2-88b3-2cba461fe361 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:08.725048 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4a87dd9a-25ee-4847-a535-cf69da48005c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:08.725820 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4a87dd9a-25ee-4847-a535-cf69da48005c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:08.733508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4a87dd9a-25ee-4847-a535-cf69da48005c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:08.733966 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4a87dd9a-25ee-4847-a535-cf69da48005c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:08.734782 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4a87dd9a-25ee-4847-a535-cf69da48005c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:08.735227 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4a87dd9a-25ee-4847-a535-cf69da48005c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:08.866797 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7c408d19-1d89-4be2-88b3-2cba461fe361 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:08.879140 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7c408d19-1d89-4be2-88b3-2cba461fe361 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1366 microversion: 2.1 time: 0.210378 May 27 09:49:08.890810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 438/863] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:08 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:08.893984 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4a87dd9a-25ee-4847-a535-cf69da48005c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:08.902559 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4a87dd9a-25ee-4847-a535-cf69da48005c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1315 microversion: 2.1 time: 0.181680 May 27 09:49:08.908561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 426/864] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:08 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:49:09.777037 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-23849226-e157-4252-80ef-3519c4438b8c req-ba6b68aa-8194-48eb-a967-354410c8637e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3773a67a-50ea-4108-acf9-06f6983edccb", "tag": "0506fbfe-bde6-4248-aef7-09e47a8abe63"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:09.787624 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-23849226-e157-4252-80ef-3519c4438b8c req-ba6b68aa-8194-48eb-a967-354410c8637e service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:09.788102 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-23849226-e157-4252-80ef-3519c4438b8c req-ba6b68aa-8194-48eb-a967-354410c8637e service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:09.801772 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-23849226-e157-4252-80ef-3519c4438b8c req-ba6b68aa-8194-48eb-a967-354410c8637e service nova] Creating event network-changed:0506fbfe-bde6-4248-aef7-09e47a8abe63 for instance 3773a67a-50ea-4108-acf9-06f6983edccb on hv-cinder-82549 May 27 09:49:09.807039 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-23849226-e157-4252-80ef-3519c4438b8c req-ba6b68aa-8194-48eb-a967-354410c8637e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034403 May 27 09:49:09.808017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 439/865] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:09.903945 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7d104496-edfb-471a-b6e0-fbd79e66a803 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:09.905238 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7d104496-edfb-471a-b6e0-fbd79e66a803 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:09.912562 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7d104496-edfb-471a-b6e0-fbd79e66a803 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:09.913016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7d104496-edfb-471a-b6e0-fbd79e66a803 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:09.913880 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7d104496-edfb-471a-b6e0-fbd79e66a803 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:09.914454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-7d104496-edfb-471a-b6e0-fbd79e66a803 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:09.920088 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-39f1ca3d-c3b6-4aa5-9994-f7b7db3c3b4c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:09.921979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-39f1ca3d-c3b6-4aa5-9994-f7b7db3c3b4c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:09.928731 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-39f1ca3d-c3b6-4aa5-9994-f7b7db3c3b4c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:09.935693 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-39f1ca3d-c3b6-4aa5-9994-f7b7db3c3b4c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:09.935693 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-39f1ca3d-c3b6-4aa5-9994-f7b7db3c3b4c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:09.935693 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-39f1ca3d-c3b6-4aa5-9994-f7b7db3c3b4c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:10.067865 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7d104496-edfb-471a-b6e0-fbd79e66a803 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:10.078884 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7d104496-edfb-471a-b6e0-fbd79e66a803 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1556 microversion: 2.1 time: 0.178857 May 27 09:49:10.090140 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 427/866] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:09 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:10.096763 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2c93bf32-c2df-49e0-99eb-74ae4e7c8358 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:10.097385 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2c93bf32-c2df-49e0-99eb-74ae4e7c8358 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:10.103944 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c93bf32-c2df-49e0-99eb-74ae4e7c8358 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:10.104491 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c93bf32-c2df-49e0-99eb-74ae4e7c8358 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:10.105412 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c93bf32-c2df-49e0-99eb-74ae4e7c8358 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:10.105865 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2c93bf32-c2df-49e0-99eb-74ae4e7c8358 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:10.133252 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-39f1ca3d-c3b6-4aa5-9994-f7b7db3c3b4c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:10.145992 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-39f1ca3d-c3b6-4aa5-9994-f7b7db3c3b4c tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1315 microversion: 2.1 time: 0.230133 May 27 09:49:10.146951 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 440/867] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:09 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:49:10.187891 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2c93bf32-c2df-49e0-99eb-74ae4e7c8358 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092187 May 27 09:49:10.187891 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 428/868] 10.222.0.48 () {58 vars in 1274 bytes} [Fri May 27 09:49:10 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:49:11.162569 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d04fe1e1-c9e6-4227-a637-51d6899740a7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:11.163239 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d04fe1e1-c9e6-4227-a637-51d6899740a7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:11.169912 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d04fe1e1-c9e6-4227-a637-51d6899740a7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:11.170669 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d04fe1e1-c9e6-4227-a637-51d6899740a7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:11.171434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d04fe1e1-c9e6-4227-a637-51d6899740a7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:11.171871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d04fe1e1-c9e6-4227-a637-51d6899740a7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:11.262405 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-eb5231bb-f659-43ea-b09a-fab1b331436e req-6b3a2746-1205-4909-9b43-d9b761df1da1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61a4f200-7733-45c0-8799-a97b6779ffa4", "tag": "4644529d-26fb-4b81-9f43-8bb9ee098aa5"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:11.271099 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-eb5231bb-f659-43ea-b09a-fab1b331436e req-6b3a2746-1205-4909-9b43-d9b761df1da1 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:11.271545 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-eb5231bb-f659-43ea-b09a-fab1b331436e req-6b3a2746-1205-4909-9b43-d9b761df1da1 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:11.283741 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-eb5231bb-f659-43ea-b09a-fab1b331436e req-6b3a2746-1205-4909-9b43-d9b761df1da1 service nova] Creating event network-changed:4644529d-26fb-4b81-9f43-8bb9ee098aa5 for instance 61a4f200-7733-45c0-8799-a97b6779ffa4 on hv-cinder-82549 May 27 09:49:11.288954 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-eb5231bb-f659-43ea-b09a-fab1b331436e req-6b3a2746-1205-4909-9b43-d9b761df1da1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030802 May 27 09:49:11.290184 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 429/869] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:49:11.307313 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d04fe1e1-c9e6-4227-a637-51d6899740a7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:11.315110 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d04fe1e1-c9e6-4227-a637-51d6899740a7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1315 microversion: 2.1 time: 0.156642 May 27 09:49:11.315679 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 441/870] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:11 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:12.333468 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0a2c82f8-3882-4d79-b382-8aee68f8a98e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:12.334224 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0a2c82f8-3882-4d79-b382-8aee68f8a98e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:12.341317 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a2c82f8-3882-4d79-b382-8aee68f8a98e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:12.341789 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a2c82f8-3882-4d79-b382-8aee68f8a98e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:12.342596 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a2c82f8-3882-4d79-b382-8aee68f8a98e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:12.343024 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a2c82f8-3882-4d79-b382-8aee68f8a98e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:12.491180 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0a2c82f8-3882-4d79-b382-8aee68f8a98e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:12.499241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0a2c82f8-3882-4d79-b382-8aee68f8a98e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1315 microversion: 2.1 time: 0.170893 May 27 09:49:12.499822 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 430/871] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:12 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:13.516282 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-fff2651c-0a8f-48ca-9bf7-9d4d6cdec02e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:13.516805 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-fff2651c-0a8f-48ca-9bf7-9d4d6cdec02e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:13.523785 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fff2651c-0a8f-48ca-9bf7-9d4d6cdec02e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:13.524240 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fff2651c-0a8f-48ca-9bf7-9d4d6cdec02e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:13.525001 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fff2651c-0a8f-48ca-9bf7-9d4d6cdec02e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:13.525439 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fff2651c-0a8f-48ca-9bf7-9d4d6cdec02e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:13.664344 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fff2651c-0a8f-48ca-9bf7-9d4d6cdec02e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:13.673326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-fff2651c-0a8f-48ca-9bf7-9d4d6cdec02e tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1315 microversion: 2.1 time: 0.161000 May 27 09:49:13.673893 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 442/872] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:13 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:14.690619 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-abcd274e-19bf-442d-b6d2-4319dc0c73af tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:14.691229 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-abcd274e-19bf-442d-b6d2-4319dc0c73af tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:14.693754 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=4 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:14.694465 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=14 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:14.699588 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-abcd274e-19bf-442d-b6d2-4319dc0c73af tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:14.700066 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-abcd274e-19bf-442d-b6d2-4319dc0c73af tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:14.700853 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-abcd274e-19bf-442d-b6d2-4319dc0c73af tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:14.701294 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-abcd274e-19bf-442d-b6d2-4319dc0c73af tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:14.841426 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-abcd274e-19bf-442d-b6d2-4319dc0c73af tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:14.848858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-abcd274e-19bf-442d-b6d2-4319dc0c73af tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1315 microversion: 2.1 time: 0.162236 May 27 09:49:14.849412 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 431/873] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:14 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:15.865949 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-fe538392-4ec5-4aa4-97b6-fe9da691b5d4 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:15.866575 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-fe538392-4ec5-4aa4-97b6-fe9da691b5d4 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:15.869005 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=10 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:15.874503 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe538392-4ec5-4aa4-97b6-fe9da691b5d4 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:15.874950 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe538392-4ec5-4aa4-97b6-fe9da691b5d4 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:15.875706 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe538392-4ec5-4aa4-97b6-fe9da691b5d4 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:15.876138 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fe538392-4ec5-4aa4-97b6-fe9da691b5d4 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:16.008529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fe538392-4ec5-4aa4-97b6-fe9da691b5d4 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:16.016767 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-fe538392-4ec5-4aa4-97b6-fe9da691b5d4 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1315 microversion: 2.1 time: 0.155031 May 27 09:49:16.017339 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 443/874] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:15 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:17.036927 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8bb50a2b-5b36-496c-8173-91116ebcde90 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:17.037567 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8bb50a2b-5b36-496c-8173-91116ebcde90 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:17.044127 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8bb50a2b-5b36-496c-8173-91116ebcde90 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:17.044578 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8bb50a2b-5b36-496c-8173-91116ebcde90 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:17.045687 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8bb50a2b-5b36-496c-8173-91116ebcde90 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:17.046117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8bb50a2b-5b36-496c-8173-91116ebcde90 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:17.178114 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8bb50a2b-5b36-496c-8173-91116ebcde90 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:17.185971 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8bb50a2b-5b36-496c-8173-91116ebcde90 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1315 microversion: 2.1 time: 0.155039 May 27 09:49:17.186581 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 432/875] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:17 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:17.248233 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-11041ecd-e510-4c62-9397-46dce9e95fbc req-694978ab-66db-48c0-beb6-7ce204def22f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3773a67a-50ea-4108-acf9-06f6983edccb", "name": "network-vif-plugged", "status": "completed", "tag": "0506fbfe-bde6-4248-aef7-09e47a8abe63"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:17.266225 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-11041ecd-e510-4c62-9397-46dce9e95fbc req-694978ab-66db-48c0-beb6-7ce204def22f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:17.266225 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-11041ecd-e510-4c62-9397-46dce9e95fbc req-694978ab-66db-48c0-beb6-7ce204def22f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:17.272789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-11041ecd-e510-4c62-9397-46dce9e95fbc req-694978ab-66db-48c0-beb6-7ce204def22f service nova] Creating event network-vif-plugged:0506fbfe-bde6-4248-aef7-09e47a8abe63 for instance 3773a67a-50ea-4108-acf9-06f6983edccb on hv-cinder-82549 May 27 09:49:17.278851 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-11041ecd-e510-4c62-9397-46dce9e95fbc req-694978ab-66db-48c0-beb6-7ce204def22f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033773 May 27 09:49:17.279659 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 444/876] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:18.202999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ee6c62de-1ff6-4500-93c6-4ed7cadd1557 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:18.203588 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ee6c62de-1ff6-4500-93c6-4ed7cadd1557 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:18.210189 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ee6c62de-1ff6-4500-93c6-4ed7cadd1557 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:18.210671 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ee6c62de-1ff6-4500-93c6-4ed7cadd1557 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:18.211444 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ee6c62de-1ff6-4500-93c6-4ed7cadd1557 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:18.211883 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ee6c62de-1ff6-4500-93c6-4ed7cadd1557 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:18.344946 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ee6c62de-1ff6-4500-93c6-4ed7cadd1557 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:18.352334 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ee6c62de-1ff6-4500-93c6-4ed7cadd1557 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1315 microversion: 2.1 time: 0.153222 May 27 09:49:18.352888 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 433/877] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:18 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:19.373117 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c631a7f5-2750-4208-9710-9bede601bab7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:19.373808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c631a7f5-2750-4208-9710-9bede601bab7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:19.380143 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c631a7f5-2750-4208-9710-9bede601bab7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:19.380544 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c631a7f5-2750-4208-9710-9bede601bab7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:19.381301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c631a7f5-2750-4208-9710-9bede601bab7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:19.381730 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c631a7f5-2750-4208-9710-9bede601bab7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:19.516658 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c631a7f5-2750-4208-9710-9bede601bab7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:19.524104 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c631a7f5-2750-4208-9710-9bede601bab7 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1315 microversion: 2.1 time: 0.156864 May 27 09:49:19.524668 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 445/878] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:19 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:20.540803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8d9d8896-fb5f-43fe-8302-d8b66209f2df tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:20.541422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8d9d8896-fb5f-43fe-8302-d8b66209f2df tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:20.549226 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8d9d8896-fb5f-43fe-8302-d8b66209f2df tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:20.549683 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8d9d8896-fb5f-43fe-8302-d8b66209f2df tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:20.550483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8d9d8896-fb5f-43fe-8302-d8b66209f2df tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:20.550926 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8d9d8896-fb5f-43fe-8302-d8b66209f2df tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:20.684434 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8d9d8896-fb5f-43fe-8302-d8b66209f2df tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:20.692598 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8d9d8896-fb5f-43fe-8302-d8b66209f2df tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1465 microversion: 2.1 time: 0.155581 May 27 09:49:20.693222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 434/879] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:20 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:20.732570 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f09298af-30a2-48a2-aca1-918f9312a386 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:20.733122 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f09298af-30a2-48a2-aca1-918f9312a386 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:20.739678 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f09298af-30a2-48a2-aca1-918f9312a386 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:20.740122 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f09298af-30a2-48a2-aca1-918f9312a386 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:20.740884 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f09298af-30a2-48a2-aca1-918f9312a386 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:20.741316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f09298af-30a2-48a2-aca1-918f9312a386 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:20.767061 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f09298af-30a2-48a2-aca1-918f9312a386 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:49:20.928752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:21.076506 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:21.250412 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f09298af-30a2-48a2-aca1-918f9312a386 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 204 len: 0 microversion: 2.1 time: 0.521976 May 27 09:49:21.251006 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 446/880] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:49:20 2022] DELETE /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 0 bytes in 523 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:49:21.259305 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-798ae3d0-ca17-4d16-a512-5cc59dcdef2f tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:21.259926 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-798ae3d0-ca17-4d16-a512-5cc59dcdef2f tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:21.266740 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-798ae3d0-ca17-4d16-a512-5cc59dcdef2f tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:21.267190 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-798ae3d0-ca17-4d16-a512-5cc59dcdef2f tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:21.267964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-798ae3d0-ca17-4d16-a512-5cc59dcdef2f tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:21.268408 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-798ae3d0-ca17-4d16-a512-5cc59dcdef2f tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:21.401651 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-798ae3d0-ca17-4d16-a512-5cc59dcdef2f tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:21.409547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-798ae3d0-ca17-4d16-a512-5cc59dcdef2f tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1471 microversion: 2.1 time: 0.154060 May 27 09:49:21.410125 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 435/881] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:21 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1471 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:22.427959 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ba1a9ed6-a74e-4fa6-ae1f-ab70c9f003b3 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:22.428587 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ba1a9ed6-a74e-4fa6-ae1f-ab70c9f003b3 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:22.435311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba1a9ed6-a74e-4fa6-ae1f-ab70c9f003b3 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:22.435760 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba1a9ed6-a74e-4fa6-ae1f-ab70c9f003b3 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:22.436518 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba1a9ed6-a74e-4fa6-ae1f-ab70c9f003b3 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:22.436954 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ba1a9ed6-a74e-4fa6-ae1f-ab70c9f003b3 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:22.566689 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ba1a9ed6-a74e-4fa6-ae1f-ab70c9f003b3 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:22.574630 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ba1a9ed6-a74e-4fa6-ae1f-ab70c9f003b3 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1471 microversion: 2.1 time: 0.151268 May 27 09:49:22.575726 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 447/882] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:22 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1471 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:23.452510 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-fc14887b-8d2c-4545-814b-bbe63c58eb59 req-2556e363-b4d7-4bf1-8ace-5e143a1133b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3773a67a-50ea-4108-acf9-06f6983edccb", "name": "network-vif-deleted", "tag": "0506fbfe-bde6-4248-aef7-09e47a8abe63"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:23.461858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-fc14887b-8d2c-4545-814b-bbe63c58eb59 req-2556e363-b4d7-4bf1-8ace-5e143a1133b0 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:23.462346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-fc14887b-8d2c-4545-814b-bbe63c58eb59 req-2556e363-b4d7-4bf1-8ace-5e143a1133b0 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:23.475658 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-fc14887b-8d2c-4545-814b-bbe63c58eb59 req-2556e363-b4d7-4bf1-8ace-5e143a1133b0 service nova] Creating event network-vif-deleted:0506fbfe-bde6-4248-aef7-09e47a8abe63 for instance 3773a67a-50ea-4108-acf9-06f6983edccb on hv-cinder-82549 May 27 09:49:23.481123 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-fc14887b-8d2c-4545-814b-bbe63c58eb59 req-2556e363-b4d7-4bf1-8ace-5e143a1133b0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032209 May 27 09:49:23.482452 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 436/883] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:49:23.592272 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6319b167-003a-43b7-8840-95ce3bf92204 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:23.594013 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6319b167-003a-43b7-8840-95ce3bf92204 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:23.601403 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6319b167-003a-43b7-8840-95ce3bf92204 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:23.601863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6319b167-003a-43b7-8840-95ce3bf92204 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:23.602778 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6319b167-003a-43b7-8840-95ce3bf92204 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:23.603221 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6319b167-003a-43b7-8840-95ce3bf92204 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:23.667195 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-6319b167-003a-43b7-8840-95ce3bf92204 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7ec3ba35ee94014aba246c60269bfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce16e6ee5e744d882a10a967fe64ad2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:23.675601 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6319b167-003a-43b7-8840-95ce3bf92204 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 200 len: 1429 microversion: 2.1 time: 0.087907 May 27 09:49:23.676165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 448/884] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:23 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:24.693507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b8df0f11-897b-4528-8bed-5f6392a80c81 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:24.694227 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b8df0f11-897b-4528-8bed-5f6392a80c81 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] [instance: 3773a67a-50ea-4108-acf9-06f6983edccb] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:24.696218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:24.701346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b8df0f11-897b-4528-8bed-5f6392a80c81 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:24.701799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b8df0f11-897b-4528-8bed-5f6392a80c81 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:24.702610 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b8df0f11-897b-4528-8bed-5f6392a80c81 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:24.703046 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b8df0f11-897b-4528-8bed-5f6392a80c81 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:24.718633 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-b8df0f11-897b-4528-8bed-5f6392a80c81 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] HTTP exception thrown: Instance 3773a67a-50ea-4108-acf9-06f6983edccb could not be found. May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b8df0f11-897b-4528-8bed-5f6392a80c81 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Request method failure captured: May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb HTTP/1.1 May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJ6N7RQLGOfFV_tBcUbH9nnZfk3_sUb8nfmQ4g5nufUOp3ZALF6W6rJe3TAS4U40zRutKPxZxTXPEpfjjaMT_EgXclE03CE1bN2aSS08Z75WppuVTfsUDrENMQ3BQuC3eJqGkr95hiAmxQcre8QngUwRv-0qu0LpXjvwg-uNf3hgFh0 May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 2ce16e6ee5e744d882a10a967fe64ad2 May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-VolumesNegativeTest-377933910 May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:49:24.725055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/2ce16e6ee5e744d882a10a967fe64ad2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ce16e6ee5e744d882a10a967fe64ad2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/2ce16e6ee5e744d882a10a967fe64ad2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_2ce16e6ee5e744d882a10a967fe64ad2", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-VolumesNegativeTest-377933910 May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 2ce16e6ee5e744d882a10a967fe64ad2 May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-VolumesNegativeTest-377933910 May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-VolumesNegativeTest-377933910-project May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: a7ec3ba35ee94014aba246c60269bfe1 May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-VolumesNegativeTest-377933910-project May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 3773a67a-50ea-4108-acf9-06f6983edccb could not be found. May 27 09:49:24.726656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '3773a67a-50ea-4108-acf9-06f6983edccb'} May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3773a67a-50ea-4108-acf9-06f6983edccb could not be found. May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:49:24.727519 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3773a67a-50ea-4108-acf9-06f6983edccb could not be found. May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3773a67a-50ea-4108-acf9-06f6983edccb could not be found. May 27 09:49:24.729122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:49:24.730527 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b8df0f11-897b-4528-8bed-5f6392a80c81 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] Returning 404 to user: Instance 3773a67a-50ea-4108-acf9-06f6983edccb could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:49:24.730527 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b8df0f11-897b-4528-8bed-5f6392a80c81 tempest-VolumesNegativeTest-377933910 tempest-VolumesNegativeTest-377933910-project] 10.222.0.48 "GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb" status: 404 len: 111 microversion: 2.1 time: 0.033084 May 27 09:49:24.730527 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 437/885] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:24 2022] GET /compute/v2.1/servers/3773a67a-50ea-4108-acf9-06f6983edccb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:49:54.918964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:49:54.920247 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 09:49:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:49:57.732264 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2dd03d3c-3b01-4a77-84b4-9c9f259f7234 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Action: 'create', calling method: .version_select at 0x7fbe322d6280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-924590235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEA/c67qCFLtCB5SL5fSWstyRGabaW2TKO3kF9HW9zQlFGnh0TDmBclqUmRBNN+Vq25vc8n7VwTT6FVnFfnWyFyg9q9r/2lDipcAawC3165C4JB4ftapke2+/fbQGlndA=="}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:57.737451 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:57.738334 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:57.751276 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-2dd03d3c-3b01-4a77-84b4-9c9f259f7234 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Getting quotas for project c8c6682d39b441fd9d58defd883f3e9a. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:49:57.755956 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-2dd03d3c-3b01-4a77-84b4-9c9f259f7234 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Getting quotas for user 25b3c1ea6b294c12a678d746cd46c72d and project c8c6682d39b441fd9d58defd883f3e9a. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:49:57.905740 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2dd03d3c-3b01-4a77-84b4-9c9f259f7234 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.177901 May 27 09:49:57.906398 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 449/886] 10.222.0.48 () {60 vars in 1158 bytes} [Fri May 27 09:49:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:49:57.958730 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1389796871", "imageRef": "86b921d4-f7ce-4c19-91ac-916ccefd5c28", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-924590235", "networks": [{"uuid": "a2c43332-f479-4bdc-983e-9f3ec618575f"}]}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:49:57.973554 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=96 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:49:58.014439 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] validate_networks() for [('a2c43332-f479-4bdc-983e-9f3ec618575f', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:49:58.435462 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:49:58.435883 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:49:58.437125 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:49:58.437635 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:49:58.438070 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:49:58.447900 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:58.448351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:58.449159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:49:58.449735 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:49:58.467963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Getting quotas for project c8c6682d39b441fd9d58defd883f3e9a. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:49:58.472680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Getting quotas for user 25b3c1ea6b294c12a678d746cd46c72d and project c8c6682d39b441fd9d58defd883f3e9a. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:49:58.486583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:49:58.488822 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='86b921d4-f7ce-4c19-91ac-916ccefd5c28',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:49:58.662453 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c37f6e31-24e5-4bc2-9d1a-1d1bb449bfb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707631 May 27 09:49:58.663012 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 438/887] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:49:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:49:58.674576 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-37bd1fde-2766-42b0-b164-bcb1e15f5088 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:58.675297 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-37bd1fde-2766-42b0-b164-bcb1e15f5088 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:58.735357 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-37bd1fde-2766-42b0-b164-bcb1e15f5088 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:58.742931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-37bd1fde-2766-42b0-b164-bcb1e15f5088 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1258 microversion: 2.1 time: 0.073220 May 27 09:49:58.743824 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 450/888] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:58 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:49:59.761193 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4d253d75-9f18-4d50-8a1d-da6bd5c9edd8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:49:59.761834 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4d253d75-9f18-4d50-8a1d-da6bd5c9edd8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:49:59.822704 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4d253d75-9f18-4d50-8a1d-da6bd5c9edd8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:49:59.835054 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4d253d75-9f18-4d50-8a1d-da6bd5c9edd8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1258 microversion: 2.1 time: 0.078170 May 27 09:49:59.836127 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 439/889] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:49:59 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:00.860222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4ab6ec67-0b77-452e-a154-4861b4a3deee tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:00.860916 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4ab6ec67-0b77-452e-a154-4861b4a3deee tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:00.868820 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ab6ec67-0b77-452e-a154-4861b4a3deee tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:00.869269 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ab6ec67-0b77-452e-a154-4861b4a3deee tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:00.870044 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ab6ec67-0b77-452e-a154-4861b4a3deee tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:00.870511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4ab6ec67-0b77-452e-a154-4861b4a3deee tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:00.935168 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4ab6ec67-0b77-452e-a154-4861b4a3deee tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:00.943373 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4ab6ec67-0b77-452e-a154-4861b4a3deee tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1254 microversion: 2.1 time: 0.087901 May 27 09:50:00.943964 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 451/890] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:00 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1254 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:01.962543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-51f722a1-6139-44a9-880d-9633e9c554d7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:01.963153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-51f722a1-6139-44a9-880d-9633e9c554d7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:01.971220 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-51f722a1-6139-44a9-880d-9633e9c554d7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:01.971669 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-51f722a1-6139-44a9-880d-9633e9c554d7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:01.972669 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-51f722a1-6139-44a9-880d-9633e9c554d7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:01.973287 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-51f722a1-6139-44a9-880d-9633e9c554d7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:02.048827 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-51f722a1-6139-44a9-880d-9633e9c554d7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:02.057468 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-51f722a1-6139-44a9-880d-9633e9c554d7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1328 microversion: 2.1 time: 0.099978 May 27 09:50:02.058076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 440/891] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:01 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:03.076917 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-fabc6bfd-4086-4b6a-9a27-4385cb20b031 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:03.078207 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-fabc6bfd-4086-4b6a-9a27-4385cb20b031 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:03.086510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fabc6bfd-4086-4b6a-9a27-4385cb20b031 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:03.089596 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fabc6bfd-4086-4b6a-9a27-4385cb20b031 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:03.089596 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fabc6bfd-4086-4b6a-9a27-4385cb20b031 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:03.089596 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-fabc6bfd-4086-4b6a-9a27-4385cb20b031 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:03.233246 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-fabc6bfd-4086-4b6a-9a27-4385cb20b031 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:03.241249 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-fabc6bfd-4086-4b6a-9a27-4385cb20b031 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.168781 May 27 09:50:03.241824 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 452/892] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:03 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:03.627364 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:50:03.627642 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 09:50:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:50:04.263339 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-72775fdc-0743-42a0-9ebb-4e61a1446dad tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:04.264116 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-72775fdc-0743-42a0-9ebb-4e61a1446dad tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:04.274707 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72775fdc-0743-42a0-9ebb-4e61a1446dad tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:04.275157 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72775fdc-0743-42a0-9ebb-4e61a1446dad tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:04.275953 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72775fdc-0743-42a0-9ebb-4e61a1446dad tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:04.276389 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-72775fdc-0743-42a0-9ebb-4e61a1446dad tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:04.425017 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-72775fdc-0743-42a0-9ebb-4e61a1446dad tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:04.437581 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-72775fdc-0743-42a0-9ebb-4e61a1446dad tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.180111 May 27 09:50:04.438338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 441/893] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:04 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:05.456745 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-109f28fd-7924-4b8a-9032-a8dddead8b6b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:05.457388 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-109f28fd-7924-4b8a-9032-a8dddead8b6b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:05.464264 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-109f28fd-7924-4b8a-9032-a8dddead8b6b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:05.464741 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-109f28fd-7924-4b8a-9032-a8dddead8b6b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:05.465558 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-109f28fd-7924-4b8a-9032-a8dddead8b6b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:05.466090 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-109f28fd-7924-4b8a-9032-a8dddead8b6b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:05.626850 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-109f28fd-7924-4b8a-9032-a8dddead8b6b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:05.635921 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-109f28fd-7924-4b8a-9032-a8dddead8b6b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.183100 May 27 09:50:05.636523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 453/894] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:05 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:06.655465 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-845d760c-0033-4a4e-9858-c70b385e2141 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:06.656713 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-845d760c-0033-4a4e-9858-c70b385e2141 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:06.664138 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-845d760c-0033-4a4e-9858-c70b385e2141 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:06.664593 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-845d760c-0033-4a4e-9858-c70b385e2141 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:06.665393 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-845d760c-0033-4a4e-9858-c70b385e2141 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:06.665850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-845d760c-0033-4a4e-9858-c70b385e2141 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:06.828676 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-845d760c-0033-4a4e-9858-c70b385e2141 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:06.836867 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-845d760c-0033-4a4e-9858-c70b385e2141 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.187217 May 27 09:50:06.837461 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 442/895] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:06 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:07.859408 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1b8461c0-a65e-4e55-a461-78177a34f060 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:07.860095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1b8461c0-a65e-4e55-a461-78177a34f060 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:07.867197 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b8461c0-a65e-4e55-a461-78177a34f060 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:07.867650 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b8461c0-a65e-4e55-a461-78177a34f060 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:07.868595 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b8461c0-a65e-4e55-a461-78177a34f060 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:07.869173 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b8461c0-a65e-4e55-a461-78177a34f060 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:08.018768 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1b8461c0-a65e-4e55-a461-78177a34f060 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:08.026493 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1b8461c0-a65e-4e55-a461-78177a34f060 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.171740 May 27 09:50:08.027077 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 454/896] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:07 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:09.048571 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-59875ec3-f480-4696-8c31-890949b5bdd5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:09.049399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-59875ec3-f480-4696-8c31-890949b5bdd5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:09.052594 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:09.059946 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-59875ec3-f480-4696-8c31-890949b5bdd5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:09.062956 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-59875ec3-f480-4696-8c31-890949b5bdd5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:09.062956 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-59875ec3-f480-4696-8c31-890949b5bdd5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:09.062956 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-59875ec3-f480-4696-8c31-890949b5bdd5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:09.217743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-59875ec3-f480-4696-8c31-890949b5bdd5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:09.226064 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-59875ec3-f480-4696-8c31-890949b5bdd5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.183008 May 27 09:50:09.228511 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 443/897] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:09 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:10.244812 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-74a2c6d1-24e4-43b2-8a05-3e6d900c753b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:10.245458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-74a2c6d1-24e4-43b2-8a05-3e6d900c753b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:10.247380 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=6 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:10.252777 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74a2c6d1-24e4-43b2-8a05-3e6d900c753b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:10.253226 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74a2c6d1-24e4-43b2-8a05-3e6d900c753b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:10.254221 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74a2c6d1-24e4-43b2-8a05-3e6d900c753b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:10.254671 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-74a2c6d1-24e4-43b2-8a05-3e6d900c753b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:10.406504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-74a2c6d1-24e4-43b2-8a05-3e6d900c753b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:10.414109 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-74a2c6d1-24e4-43b2-8a05-3e6d900c753b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.173591 May 27 09:50:10.414775 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 455/898] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:10 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:11.431113 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-71e43b47-94be-478c-b1a0-fb612ae9ef42 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:11.431766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-71e43b47-94be-478c-b1a0-fb612ae9ef42 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:11.433595 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=8 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:11.438973 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71e43b47-94be-478c-b1a0-fb612ae9ef42 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:11.439422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71e43b47-94be-478c-b1a0-fb612ae9ef42 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:11.440238 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71e43b47-94be-478c-b1a0-fb612ae9ef42 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:11.440674 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-71e43b47-94be-478c-b1a0-fb612ae9ef42 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:11.558312 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-2d8e8822-c83a-4eb1-963b-272d80ebd687 req-37698797-c834-4be7-9eea-02725ee58afb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b83df12-67ab-4003-bdb5-f2be8c59c517", "tag": "4c3ba279-e102-4d82-82bf-7258d5f7c7c1"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:11.579161 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-71e43b47-94be-478c-b1a0-fb612ae9ef42 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:11.581044 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-2d8e8822-c83a-4eb1-963b-272d80ebd687 req-37698797-c834-4be7-9eea-02725ee58afb service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:11.581485 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-2d8e8822-c83a-4eb1-963b-272d80ebd687 req-37698797-c834-4be7-9eea-02725ee58afb service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:11.587048 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-71e43b47-94be-478c-b1a0-fb612ae9ef42 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.159726 May 27 09:50:11.587630 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 444/899] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:11 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:11.596853 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-2d8e8822-c83a-4eb1-963b-272d80ebd687 req-37698797-c834-4be7-9eea-02725ee58afb service nova] Creating event network-changed:4c3ba279-e102-4d82-82bf-7258d5f7c7c1 for instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 on hv-cinder-82549 May 27 09:50:11.603133 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-2d8e8822-c83a-4eb1-963b-272d80ebd687 req-37698797-c834-4be7-9eea-02725ee58afb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052459 May 27 09:50:11.603864 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 456/900] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:12.604370 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5bb1431a-9cec-47f8-82df-47401673e32e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:12.612555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5bb1431a-9cec-47f8-82df-47401673e32e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:12.612555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5bb1431a-9cec-47f8-82df-47401673e32e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:12.612555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5bb1431a-9cec-47f8-82df-47401673e32e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:12.613052 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5bb1431a-9cec-47f8-82df-47401673e32e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:12.613490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5bb1431a-9cec-47f8-82df-47401673e32e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:12.745872 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-5bb1431a-9cec-47f8-82df-47401673e32e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:12.753612 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5bb1431a-9cec-47f8-82df-47401673e32e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.153366 May 27 09:50:12.754330 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 445/901] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:12 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:13.772047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e619b203-dec6-4ec0-8c36-47d980c6e067 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:13.772756 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e619b203-dec6-4ec0-8c36-47d980c6e067 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:13.780296 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e619b203-dec6-4ec0-8c36-47d980c6e067 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:13.788856 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e619b203-dec6-4ec0-8c36-47d980c6e067 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:13.788856 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e619b203-dec6-4ec0-8c36-47d980c6e067 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:13.788856 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e619b203-dec6-4ec0-8c36-47d980c6e067 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:13.980906 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e619b203-dec6-4ec0-8c36-47d980c6e067 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:13.988446 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e619b203-dec6-4ec0-8c36-47d980c6e067 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.220857 May 27 09:50:13.989021 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 457/902] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:13 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:15.005245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2dfc5395-185a-4c29-9fb3-691029c9e48b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:15.005902 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2dfc5395-185a-4c29-9fb3-691029c9e48b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:15.013095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2dfc5395-185a-4c29-9fb3-691029c9e48b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:15.013654 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2dfc5395-185a-4c29-9fb3-691029c9e48b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:15.014463 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2dfc5395-185a-4c29-9fb3-691029c9e48b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:15.014903 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2dfc5395-185a-4c29-9fb3-691029c9e48b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:15.139774 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2dfc5395-185a-4c29-9fb3-691029c9e48b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:15.147181 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2dfc5395-185a-4c29-9fb3-691029c9e48b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.145841 May 27 09:50:15.147743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 446/903] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:15 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:16.163615 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-af9c8c01-69be-4da6-a8da-a3f7e800da62 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:16.164330 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-af9c8c01-69be-4da6-a8da-a3f7e800da62 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:16.171588 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-af9c8c01-69be-4da6-a8da-a3f7e800da62 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:16.172033 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-af9c8c01-69be-4da6-a8da-a3f7e800da62 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:16.172808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-af9c8c01-69be-4da6-a8da-a3f7e800da62 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:16.173238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-af9c8c01-69be-4da6-a8da-a3f7e800da62 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:16.331418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-af9c8c01-69be-4da6-a8da-a3f7e800da62 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:16.339146 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-af9c8c01-69be-4da6-a8da-a3f7e800da62 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.179519 May 27 09:50:16.339810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 458/904] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:16 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:17.356287 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e319e059-bf24-4470-82f6-6a12a9f6d952 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:17.356939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e319e059-bf24-4470-82f6-6a12a9f6d952 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:17.363610 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e319e059-bf24-4470-82f6-6a12a9f6d952 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:17.364067 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e319e059-bf24-4470-82f6-6a12a9f6d952 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:17.364848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e319e059-bf24-4470-82f6-6a12a9f6d952 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:17.365290 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e319e059-bf24-4470-82f6-6a12a9f6d952 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:17.502496 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e319e059-bf24-4470-82f6-6a12a9f6d952 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:17.510586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e319e059-bf24-4470-82f6-6a12a9f6d952 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.158181 May 27 09:50:17.511172 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 447/905] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:17 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:18.528268 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6eaa3590-c581-426f-8ade-c153ea6bef0b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:18.528875 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6eaa3590-c581-426f-8ade-c153ea6bef0b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:18.535823 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6eaa3590-c581-426f-8ade-c153ea6bef0b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:18.536157 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6eaa3590-c581-426f-8ade-c153ea6bef0b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:18.536933 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6eaa3590-c581-426f-8ade-c153ea6bef0b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:18.537367 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6eaa3590-c581-426f-8ade-c153ea6bef0b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:18.673274 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-6eaa3590-c581-426f-8ade-c153ea6bef0b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:18.680942 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6eaa3590-c581-426f-8ade-c153ea6bef0b tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.156768 May 27 09:50:18.681512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 459/906] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:18 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:19.510594 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-94952815-40b9-4a09-a396-880b0ff13723 req-f44e51fe-fc93-43f4-9570-4fdad1465f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b83df12-67ab-4003-bdb5-f2be8c59c517", "name": "network-vif-plugged", "status": "completed", "tag": "4c3ba279-e102-4d82-82bf-7258d5f7c7c1"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:19.519790 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-94952815-40b9-4a09-a396-880b0ff13723 req-f44e51fe-fc93-43f4-9570-4fdad1465f38 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:19.520232 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-94952815-40b9-4a09-a396-880b0ff13723 req-f44e51fe-fc93-43f4-9570-4fdad1465f38 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:19.531749 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-94952815-40b9-4a09-a396-880b0ff13723 req-f44e51fe-fc93-43f4-9570-4fdad1465f38 service nova] Creating event network-vif-plugged:4c3ba279-e102-4d82-82bf-7258d5f7c7c1 for instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 on hv-cinder-82549 May 27 09:50:19.537126 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-94952815-40b9-4a09-a396-880b0ff13723 req-f44e51fe-fc93-43f4-9570-4fdad1465f38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030832 May 27 09:50:19.537780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 448/907] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:19.696869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-05de48aa-5b13-47a3-91cb-076f658e46c7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:19.697582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-05de48aa-5b13-47a3-91cb-076f658e46c7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:19.704502 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-05de48aa-5b13-47a3-91cb-076f658e46c7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:19.708628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-05de48aa-5b13-47a3-91cb-076f658e46c7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:19.708628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-05de48aa-5b13-47a3-91cb-076f658e46c7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:19.708628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-05de48aa-5b13-47a3-91cb-076f658e46c7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:19.842506 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-05de48aa-5b13-47a3-91cb-076f658e46c7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:19.855561 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-05de48aa-5b13-47a3-91cb-076f658e46c7 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.162430 May 27 09:50:19.856782 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 460/908] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:19 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:20.874570 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-008bba3c-50df-419d-8ab6-5b9a4a8e8af5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:20.875287 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-008bba3c-50df-419d-8ab6-5b9a4a8e8af5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:20.881572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-008bba3c-50df-419d-8ab6-5b9a4a8e8af5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:20.888565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-008bba3c-50df-419d-8ab6-5b9a4a8e8af5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:20.888565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-008bba3c-50df-419d-8ab6-5b9a4a8e8af5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:20.888565 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-008bba3c-50df-419d-8ab6-5b9a4a8e8af5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:21.017013 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-008bba3c-50df-419d-8ab6-5b9a4a8e8af5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:21.025284 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-008bba3c-50df-419d-8ab6-5b9a4a8e8af5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1358 microversion: 2.1 time: 0.155908 May 27 09:50:21.025875 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 449/909] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:20 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:22.043191 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6848b2fc-a482-4b5b-b617-6d98084c5314 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:22.043810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6848b2fc-a482-4b5b-b617-6d98084c5314 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:22.050870 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6848b2fc-a482-4b5b-b617-6d98084c5314 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:22.051319 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6848b2fc-a482-4b5b-b617-6d98084c5314 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:22.052091 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6848b2fc-a482-4b5b-b617-6d98084c5314 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:22.052523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6848b2fc-a482-4b5b-b617-6d98084c5314 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:22.180345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-6848b2fc-a482-4b5b-b617-6d98084c5314 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:22.188426 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6848b2fc-a482-4b5b-b617-6d98084c5314 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1548 microversion: 2.1 time: 0.149266 May 27 09:50:22.189170 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 461/910] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:22 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:22.205112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-58137d5b-687b-49cb-9d4f-1d62fd17f6dc tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:22.205741 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-58137d5b-687b-49cb-9d4f-1d62fd17f6dc tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:22.212399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-58137d5b-687b-49cb-9d4f-1d62fd17f6dc tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:22.212844 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-58137d5b-687b-49cb-9d4f-1d62fd17f6dc tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:22.213597 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-58137d5b-687b-49cb-9d4f-1d62fd17f6dc tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:22.214024 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-58137d5b-687b-49cb-9d4f-1d62fd17f6dc tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:22.340893 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-58137d5b-687b-49cb-9d4f-1d62fd17f6dc tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:22.348330 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-58137d5b-687b-49cb-9d4f-1d62fd17f6dc tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1548 microversion: 2.1 time: 0.147567 May 27 09:50:22.352647 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 450/911] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:22 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:22.364579 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ceb92471-ed75-4a71-a6fa-e8ae819c747f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:22.367980 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ceb92471-ed75-4a71-a6fa-e8ae819c747f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:22.368742 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ceb92471-ed75-4a71-a6fa-e8ae819c747f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Searching by: {'deleted': False, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a'} {{(pid=124829) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 27 09:50:22.375897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ceb92471-ed75-4a71-a6fa-e8ae819c747f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:22.376345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ceb92471-ed75-4a71-a6fa-e8ae819c747f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:22.377266 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ceb92471-ed75-4a71-a6fa-e8ae819c747f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:22.377575 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ceb92471-ed75-4a71-a6fa-e8ae819c747f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:22.466358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.multi_cell_list [None req-ceb92471-ed75-4a71-a6fa-e8ae819c747f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124829) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 27 09:50:22.563104 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ceb92471-ed75-4a71-a6fa-e8ae819c747f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.202267 May 27 09:50:22.563688 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 462/912] 10.222.0.48 () {58 vars in 1124 bytes} [Fri May 27 09:50:22 2022] GET /compute/v2.1/servers => generated 343 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:22.573672 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-089e5058-be72-4df3-a55a-1820f47f7434 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:22.574320 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-089e5058-be72-4df3-a55a-1820f47f7434 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:22.580832 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-089e5058-be72-4df3-a55a-1820f47f7434 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:22.581274 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-089e5058-be72-4df3-a55a-1820f47f7434 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:22.582021 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-089e5058-be72-4df3-a55a-1820f47f7434 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:22.582491 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-089e5058-be72-4df3-a55a-1820f47f7434 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:22.712101 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-089e5058-be72-4df3-a55a-1820f47f7434 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:22.719715 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-089e5058-be72-4df3-a55a-1820f47f7434 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1548 microversion: 2.1 time: 0.149796 May 27 09:50:22.720288 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 451/913] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:22 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:24.632927 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-37264cd5-8eed-49b6-adde-003fcd20e357 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a391400-77f2-4dd2-aa80-828e3707603e"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:24.633992 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-37264cd5-8eed-49b6-adde-003fcd20e357 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:24.640564 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-37264cd5-8eed-49b6-adde-003fcd20e357 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:24.641067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-37264cd5-8eed-49b6-adde-003fcd20e357 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:24.641830 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-37264cd5-8eed-49b6-adde-003fcd20e357 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:24.642294 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-37264cd5-8eed-49b6-adde-003fcd20e357 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:25.381324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-37264cd5-8eed-49b6-adde-003fcd20e357 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "POST /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752289 May 27 09:50:25.381956 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 463/914] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:50:24 2022] POST /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:32.935796 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-aa1e0d7c-7bb0-4208-b3f5-d5b7a7110a51 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:32.936407 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-aa1e0d7c-7bb0-4208-b3f5-d5b7a7110a51 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:32.938781 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:32.939478 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=70 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:32.944282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aa1e0d7c-7bb0-4208-b3f5-d5b7a7110a51 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:32.944756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aa1e0d7c-7bb0-4208-b3f5-d5b7a7110a51 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:32.945552 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aa1e0d7c-7bb0-4208-b3f5-d5b7a7110a51 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:32.945974 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aa1e0d7c-7bb0-4208-b3f5-d5b7a7110a51 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:33.076723 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-aa1e0d7c-7bb0-4208-b3f5-d5b7a7110a51 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:33.085348 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-aa1e0d7c-7bb0-4208-b3f5-d5b7a7110a51 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1594 microversion: 2.1 time: 0.153408 May 27 09:50:33.085964 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 452/915] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:32 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:35.136932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:35.138123 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:35.143048 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-99264754-e20d-48e9-85f3-28f39f290e2a req-67d83625-fbc8-49a3-85ef-66d2d402d96e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b83df12-67ab-4003-bdb5-f2be8c59c517", "tag": "4c3ba279-e102-4d82-82bf-7258d5f7c7c1"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:35.152461 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-99264754-e20d-48e9-85f3-28f39f290e2a req-67d83625-fbc8-49a3-85ef-66d2d402d96e service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:35.159862 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-99264754-e20d-48e9-85f3-28f39f290e2a req-67d83625-fbc8-49a3-85ef-66d2d402d96e service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:35.159862 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:50:35.163560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-99264754-e20d-48e9-85f3-28f39f290e2a req-67d83625-fbc8-49a3-85ef-66d2d402d96e service nova] Creating event network-changed:4c3ba279-e102-4d82-82bf-7258d5f7c7c1 for instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 on hv-cinder-82549 May 27 09:50:35.168646 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-99264754-e20d-48e9-85f3-28f39f290e2a req-67d83625-fbc8-49a3-85ef-66d2d402d96e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033364 May 27 09:50:35.169680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 464/916] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:37.814367 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e0426151-ed26-4928-b462-68a4c156a43a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1927724784"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:37.817656 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e0426151-ed26-4928-b462-68a4c156a43a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:37.822933 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0426151-ed26-4928-b462-68a4c156a43a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:37.823424 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0426151-ed26-4928-b462-68a4c156a43a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:37.824254 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0426151-ed26-4928-b462-68a4c156a43a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:37.824738 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e0426151-ed26-4928-b462-68a4c156a43a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:37.952193 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.network.security_group_api [None req-e0426151-ed26-4928-b462-68a4c156a43a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Adding security group 9e79336e-9a87-4118-8813-5923c5d50537 to port 4c3ba279-e102-4d82-82bf-7258d5f7c7c1 May 27 09:50:38.155134 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ff1235a6-35e7-4d0b-8868-7b672ea88a65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:38.156980 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ff1235a6-35e7-4d0b-8868-7b672ea88a65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:38.164550 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ff1235a6-35e7-4d0b-8868-7b672ea88a65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.164997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ff1235a6-35e7-4d0b-8868-7b672ea88a65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.165777 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ff1235a6-35e7-4d0b-8868-7b672ea88a65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.166238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ff1235a6-35e7-4d0b-8868-7b672ea88a65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.190508 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ff1235a6-35e7-4d0b-8868-7b672ea88a65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4/ips" status: 200 len: 150 microversion: 2.1 time: 0.040451 May 27 09:50:38.195335 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 465/917] 10.222.0.48 () {58 vars in 1247 bytes} [Fri May 27 09:50:38 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:50:38.201452 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2e2d3907-454f-4b04-ab86-bede31bdba95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:38.202476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2e2d3907-454f-4b04-ab86-bede31bdba95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:38.208705 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2e2d3907-454f-4b04-ab86-bede31bdba95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.209154 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2e2d3907-454f-4b04-ab86-bede31bdba95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.209920 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2e2d3907-454f-4b04-ab86-bede31bdba95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.210392 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2e2d3907-454f-4b04-ab86-bede31bdba95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.293017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-2e2d3907-454f-4b04-ab86-bede31bdba95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Invalid volume: volume 4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b is already attached to instances: 1d52913b-ebb2-470d-aafe-129bead9bedf May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2e2d3907-454f-4b04-ab86-bede31bdba95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: POST /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4/os-volume_attachments HTTP/1.1 May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 74 May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:50:38.295128 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {"volumeAttachment": {"volumeId": "4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b"}} May 27 09:50:38.296751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Invalid volume: volume 4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b is already attached to instances: 1d52913b-ebb2-470d-aafe-129bead9bedf May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'server_id': '61a4f200-7733-45c0-8799-a97b6779ffa4', 'body': {'volumeAttachment': {'volumeId': '4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b'}}} May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b is already attached to instances: 1d52913b-ebb2-470d-aafe-129bead9bedf May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:38.297717 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b is already attached to instances: 1d52913b-ebb2-470d-aafe-129bead9bedf May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:38.299202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:38.300817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:38.300817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:50:38.300817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:50:38.300817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b is already attached to instances: 1d52913b-ebb2-470d-aafe-129bead9bedf May 27 09:50:38.300817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:38.300817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2e2d3907-454f-4b04-ab86-bede31bdba95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 400 to user: Invalid volume: volume 4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b is already attached to instances: 1d52913b-ebb2-470d-aafe-129bead9bedf {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:50:38.300817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2e2d3907-454f-4b04-ab86-bede31bdba95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099120 May 27 09:50:38.300817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 466/918] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:50:38 2022] POST /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 27 09:50:38.305075 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0cc495ba-3afb-44da-a5e0-36d5510113df tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:38.305570 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0cc495ba-3afb-44da-a5e0-36d5510113df tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:38.311750 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0cc495ba-3afb-44da-a5e0-36d5510113df tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.312232 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0cc495ba-3afb-44da-a5e0-36d5510113df tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.312991 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0cc495ba-3afb-44da-a5e0-36d5510113df tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.313418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0cc495ba-3afb-44da-a5e0-36d5510113df tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.338789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0cc495ba-3afb-44da-a5e0-36d5510113df tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:50:38.439263 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e0426151-ed26-4928-b462-68a4c156a43a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "POST /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/action" status: 202 len: 0 microversion: 2.1 time: 0.630396 May 27 09:50:38.440317 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 453/919] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:50:37 2022] POST /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:50:38.450595 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-16288b14-4d0c-4358-b0d1-a656847d88e9 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:38.451620 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-16288b14-4d0c-4358-b0d1-a656847d88e9 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:38.459397 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-16288b14-4d0c-4358-b0d1-a656847d88e9 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.461042 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-16288b14-4d0c-4358-b0d1-a656847d88e9 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.469831 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-16288b14-4d0c-4358-b0d1-a656847d88e9 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.470792 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-16288b14-4d0c-4358-b0d1-a656847d88e9 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.644847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-16288b14-4d0c-4358-b0d1-a656847d88e9 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:38.655536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-16288b14-4d0c-4358-b0d1-a656847d88e9 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1760 microversion: 2.1 time: 0.210795 May 27 09:50:38.656858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 454/920] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:38 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1760 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:38.662462 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-50d5775c-4b83-425f-8371-277d82cb4a2f req-2851d8d7-83a4-43ea-b49a-f79b0c18830a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b83df12-67ab-4003-bdb5-f2be8c59c517", "tag": "4c3ba279-e102-4d82-82bf-7258d5f7c7c1"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:38.672596 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-50d5775c-4b83-425f-8371-277d82cb4a2f req-2851d8d7-83a4-43ea-b49a-f79b0c18830a service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.673506 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-50d5775c-4b83-425f-8371-277d82cb4a2f req-2851d8d7-83a4-43ea-b49a-f79b0c18830a service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.685914 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-50d5775c-4b83-425f-8371-277d82cb4a2f req-2851d8d7-83a4-43ea-b49a-f79b0c18830a service nova] Creating event network-changed:4c3ba279-e102-4d82-82bf-7258d5f7c7c1 for instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 on hv-cinder-82549 May 27 09:50:38.691950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-50d5775c-4b83-425f-8371-277d82cb4a2f req-2851d8d7-83a4-43ea-b49a-f79b0c18830a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033670 May 27 09:50:38.692542 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 455/921] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:38.753261 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0cc495ba-3afb-44da-a5e0-36d5510113df tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 204 len: 0 microversion: 2.1 time: 0.451315 May 27 09:50:38.754342 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 467/922] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:50:38 2022] DELETE /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:50:38.764455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9b4d5578-fb7f-46f5-977e-2a7423919748 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:38.766155 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9b4d5578-fb7f-46f5-977e-2a7423919748 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:38.773763 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9b4d5578-fb7f-46f5-977e-2a7423919748 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.774655 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9b4d5578-fb7f-46f5-977e-2a7423919748 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.775822 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9b4d5578-fb7f-46f5-977e-2a7423919748 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:38.776594 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9b4d5578-fb7f-46f5-977e-2a7423919748 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:38.911922 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9b4d5578-fb7f-46f5-977e-2a7423919748 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:38.920010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9b4d5578-fb7f-46f5-977e-2a7423919748 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1681 microversion: 2.1 time: 0.160203 May 27 09:50:38.920952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 456/923] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:38 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:39.939096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5489f690-a7a9-46a9-8e54-29e3c5a20ee3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:39.939673 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5489f690-a7a9-46a9-8e54-29e3c5a20ee3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:39.946461 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5489f690-a7a9-46a9-8e54-29e3c5a20ee3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:39.947028 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5489f690-a7a9-46a9-8e54-29e3c5a20ee3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:39.947846 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5489f690-a7a9-46a9-8e54-29e3c5a20ee3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:39.948394 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5489f690-a7a9-46a9-8e54-29e3c5a20ee3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:40.140096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5489f690-a7a9-46a9-8e54-29e3c5a20ee3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:40.148562 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5489f690-a7a9-46a9-8e54-29e3c5a20ee3 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1681 microversion: 2.1 time: 0.213897 May 27 09:50:40.149136 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 468/924] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:39 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:41.166969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-194fcc63-e0ae-4c9a-a0fa-700b72557947 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:41.167513 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-194fcc63-e0ae-4c9a-a0fa-700b72557947 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:41.176422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-194fcc63-e0ae-4c9a-a0fa-700b72557947 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:41.176422 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-194fcc63-e0ae-4c9a-a0fa-700b72557947 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:41.176905 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-194fcc63-e0ae-4c9a-a0fa-700b72557947 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:41.177342 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-194fcc63-e0ae-4c9a-a0fa-700b72557947 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:41.389978 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-194fcc63-e0ae-4c9a-a0fa-700b72557947 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:41.398186 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-194fcc63-e0ae-4c9a-a0fa-700b72557947 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1681 microversion: 2.1 time: 0.235216 May 27 09:50:41.398793 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 457/925] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:41 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1681 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:41.820163 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-4fdb422c-488b-4350-b56c-119672868827 req-2b536488-9e8b-4810-adf6-0f31ccae8a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61a4f200-7733-45c0-8799-a97b6779ffa4", "name": "network-vif-deleted", "tag": "4644529d-26fb-4b81-9f43-8bb9ee098aa5"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:41.830446 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-4fdb422c-488b-4350-b56c-119672868827 req-2b536488-9e8b-4810-adf6-0f31ccae8a49 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:41.831172 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-4fdb422c-488b-4350-b56c-119672868827 req-2b536488-9e8b-4810-adf6-0f31ccae8a49 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:41.844584 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-4fdb422c-488b-4350-b56c-119672868827 req-2b536488-9e8b-4810-adf6-0f31ccae8a49 service nova] Creating event network-vif-deleted:4644529d-26fb-4b81-9f43-8bb9ee098aa5 for instance 61a4f200-7733-45c0-8799-a97b6779ffa4 on hv-cinder-82549 May 27 09:50:41.849612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-4fdb422c-488b-4350-b56c-119672868827 req-2b536488-9e8b-4810-adf6-0f31ccae8a49 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034392 May 27 09:50:41.850462 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 469/926] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:42.415501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:42.416096 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:42.424983 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:42.425473 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:42.426288 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:42.426731 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:42.459481 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:42.459927 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:42.460376 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lazy-loading 'fault' on Instance uuid 61a4f200-7733-45c0-8799-a97b6779ffa4 {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:50:42.506176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:42.514327 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e181d6a5-5602-46d0-a182-5dc96dff0bd9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 200 len: 1330 microversion: 2.1 time: 0.102721 May 27 09:50:42.514900 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 458/927] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:42 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 1330 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:43.531931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-17227770-d146-435c-9e1e-25b73dfb6675 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:43.532637 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-17227770-d146-435c-9e1e-25b73dfb6675 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:43.539467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-17227770-d146-435c-9e1e-25b73dfb6675 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:43.539918 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-17227770-d146-435c-9e1e-25b73dfb6675 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:43.540686 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-17227770-d146-435c-9e1e-25b73dfb6675 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:43.541121 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-17227770-d146-435c-9e1e-25b73dfb6675 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:43.555337 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-17227770-d146-435c-9e1e-25b73dfb6675 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-17227770-d146-435c-9e1e-25b73dfb6675 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 HTTP/1.1 May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:50:43.556974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:50:43.558491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '61a4f200-7733-45c0-8799-a97b6779ffa4'} May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:50:43.559238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:50:43.560597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:43.561914 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-17227770-d146-435c-9e1e-25b73dfb6675 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:50:43.561914 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-17227770-d146-435c-9e1e-25b73dfb6675 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 404 len: 111 microversion: 2.1 time: 0.030699 May 27 09:50:43.561914 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 470/928] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:43 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:50:43.568135 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-87d58270-77f5-49e9-b9c2-9a4cf93b073f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '.version_select at 0x7fbe32534af0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:43.693111 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-87d58270-77f5-49e9-b9c2-9a4cf93b073f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-352596151" status: 202 len: 0 microversion: 2.1 time: 0.128792 May 27 09:50:43.693703 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 459/929] 10.222.0.48 () {58 vars in 1217 bytes} [Fri May 27 09:50:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-352596151 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:50:44.564833 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e21e0888-f31b-4dcf-b569-592115980c5e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:44.565351 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e21e0888-f31b-4dcf-b569-592115980c5e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:44.571940 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e21e0888-f31b-4dcf-b569-592115980c5e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:44.572397 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e21e0888-f31b-4dcf-b569-592115980c5e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:44.573173 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e21e0888-f31b-4dcf-b569-592115980c5e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:44.573614 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e21e0888-f31b-4dcf-b569-592115980c5e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:44.655219 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-e21e0888-f31b-4dcf-b569-592115980c5e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lazy-loading 'services' on Instance uuid 1d52913b-ebb2-470d-aafe-129bead9bedf {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:50:44.916017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e21e0888-f31b-4dcf-b569-592115980c5e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-volume_attachments/4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b" status: 202 len: 0 microversion: 2.1 time: 0.355121 May 27 09:50:44.916605 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 471/930] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:50:44 2022] DELETE /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-volume_attachments/4dc23e5a-7de3-4a52-b9aa-82f6faadcc0b => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:50:44.925382 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d5db5004-ebdf-415e-9fa2-eb7e32cbf607 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:44.926378 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d5db5004-ebdf-415e-9fa2-eb7e32cbf607 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:44.933548 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5db5004-ebdf-415e-9fa2-eb7e32cbf607 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:44.934029 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5db5004-ebdf-415e-9fa2-eb7e32cbf607 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:44.934835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5db5004-ebdf-415e-9fa2-eb7e32cbf607 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:44.935278 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5db5004-ebdf-415e-9fa2-eb7e32cbf607 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:44.965745 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d5db5004-ebdf-415e-9fa2-eb7e32cbf607 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 May 27 09:50:44.966346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 460/931] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:50:44 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:45.977678 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8e5450d6-1ad7-456f-af5a-306e6f6cdfb0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:45.978759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8e5450d6-1ad7-456f-af5a-306e6f6cdfb0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:45.985524 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8e5450d6-1ad7-456f-af5a-306e6f6cdfb0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:45.985958 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8e5450d6-1ad7-456f-af5a-306e6f6cdfb0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:45.986739 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8e5450d6-1ad7-456f-af5a-306e6f6cdfb0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:45.987169 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8e5450d6-1ad7-456f-af5a-306e6f6cdfb0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:46.016286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8e5450d6-1ad7-456f-af5a-306e6f6cdfb0 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042417 May 27 09:50:46.016853 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 472/932] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:50:45 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:47.028080 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9d0e195c-1b8c-47c0-92c7-91569d26d0b2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:47.028995 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9d0e195c-1b8c-47c0-92c7-91569d26d0b2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:47.036099 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9d0e195c-1b8c-47c0-92c7-91569d26d0b2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:47.036543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9d0e195c-1b8c-47c0-92c7-91569d26d0b2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:47.037331 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9d0e195c-1b8c-47c0-92c7-91569d26d0b2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:47.037826 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9d0e195c-1b8c-47c0-92c7-91569d26d0b2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:47.066655 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9d0e195c-1b8c-47c0-92c7-91569d26d0b2 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042514 May 27 09:50:47.067215 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 461/933] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:50:47 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:50:47.124164 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2c3170a9-8c2b-4555-9a6f-f58d371c143f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:47.124752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2c3170a9-8c2b-4555-9a6f-f58d371c143f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:47.131154 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c3170a9-8c2b-4555-9a6f-f58d371c143f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:47.131592 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c3170a9-8c2b-4555-9a6f-f58d371c143f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:47.132340 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c3170a9-8c2b-4555-9a6f-f58d371c143f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:47.132766 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c3170a9-8c2b-4555-9a6f-f58d371c143f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:47.157483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2c3170a9-8c2b-4555-9a6f-f58d371c143f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:50:47.459919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2c3170a9-8c2b-4555-9a6f-f58d371c143f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 204 len: 0 microversion: 2.1 time: 0.339098 May 27 09:50:47.460390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 473/934] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:50:47 2022] DELETE /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:50:47.468608 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ef7432f9-a387-4874-880d-e729d77beaea tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:47.469863 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ef7432f9-a387-4874-880d-e729d77beaea tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:47.475303 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ef7432f9-a387-4874-880d-e729d77beaea tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:47.475757 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ef7432f9-a387-4874-880d-e729d77beaea tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:47.476520 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ef7432f9-a387-4874-880d-e729d77beaea tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:47.476954 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ef7432f9-a387-4874-880d-e729d77beaea tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:47.606549 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ef7432f9-a387-4874-880d-e729d77beaea tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:47.614492 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ef7432f9-a387-4874-880d-e729d77beaea tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1682 microversion: 2.1 time: 0.149744 May 27 09:50:47.615055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 462/935] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:47 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:48.632781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d387eefe-7f7f-4c20-83ca-b6d4af24d5ad tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:48.633478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d387eefe-7f7f-4c20-83ca-b6d4af24d5ad tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:48.640161 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d387eefe-7f7f-4c20-83ca-b6d4af24d5ad tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:48.641140 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d387eefe-7f7f-4c20-83ca-b6d4af24d5ad tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:48.641897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d387eefe-7f7f-4c20-83ca-b6d4af24d5ad tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:48.642365 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d387eefe-7f7f-4c20-83ca-b6d4af24d5ad tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:48.773523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d387eefe-7f7f-4c20-83ca-b6d4af24d5ad tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:48.781119 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d387eefe-7f7f-4c20-83ca-b6d4af24d5ad tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1682 microversion: 2.1 time: 0.152798 May 27 09:50:48.781677 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 474/936] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:48 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:49.798652 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-36d97dfc-879f-4bc4-918a-ed2520584994 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:49.799286 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-36d97dfc-879f-4bc4-918a-ed2520584994 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:49.806421 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-36d97dfc-879f-4bc4-918a-ed2520584994 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:49.807009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-36d97dfc-879f-4bc4-918a-ed2520584994 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:49.807817 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-36d97dfc-879f-4bc4-918a-ed2520584994 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:49.808276 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-36d97dfc-879f-4bc4-918a-ed2520584994 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:49.967826 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-36d97dfc-879f-4bc4-918a-ed2520584994 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:49.976529 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-36d97dfc-879f-4bc4-918a-ed2520584994 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1682 microversion: 2.1 time: 0.182041 May 27 09:50:49.981158 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 463/937] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:49 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1682 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:50.311423 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-8451e3a1-d1f5-4228-959b-7ed44f5c2b89 req-ceb98a67-1cf9-4b37-beb1-08a8c4d55534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d52913b-ebb2-470d-aafe-129bead9bedf", "name": "network-vif-deleted", "tag": "7a6aa9ff-d804-497b-a4d3-1d5d81882bcd"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:50.320888 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-8451e3a1-d1f5-4228-959b-7ed44f5c2b89 req-ceb98a67-1cf9-4b37-beb1-08a8c4d55534 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:50.321334 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-8451e3a1-d1f5-4228-959b-7ed44f5c2b89 req-ceb98a67-1cf9-4b37-beb1-08a8c4d55534 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:50.332557 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-8451e3a1-d1f5-4228-959b-7ed44f5c2b89 req-ceb98a67-1cf9-4b37-beb1-08a8c4d55534 service nova] Creating event network-vif-deleted:7a6aa9ff-d804-497b-a4d3-1d5d81882bcd for instance 1d52913b-ebb2-470d-aafe-129bead9bedf on hv-cinder-82549 May 27 09:50:50.338817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-8451e3a1-d1f5-4228-959b-7ed44f5c2b89 req-ceb98a67-1cf9-4b37-beb1-08a8c4d55534 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029870 May 27 09:50:50.338817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 475/938] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:50.994431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:50.995068 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:51.002020 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:51.002720 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:51.003512 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:51.003956 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:51.038979 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:51.039460 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:51.039937 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lazy-loading 'fault' on Instance uuid 1d52913b-ebb2-470d-aafe-129bead9bedf {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:50:51.083640 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:51.093533 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bc9b6699-a1ff-4e92-897c-d676e77bce78 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 200 len: 1331 microversion: 2.1 time: 0.102845 May 27 09:50:51.094986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 464/939] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:50 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:52.113208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3c1c4130-61f6-466a-adbb-f70b3cdaa4b4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:52.113906 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3c1c4130-61f6-466a-adbb-f70b3cdaa4b4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:52.120242 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c1c4130-61f6-466a-adbb-f70b3cdaa4b4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:52.120690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c1c4130-61f6-466a-adbb-f70b3cdaa4b4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:52.121447 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c1c4130-61f6-466a-adbb-f70b3cdaa4b4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:52.121885 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c1c4130-61f6-466a-adbb-f70b3cdaa4b4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:52.137553 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-3c1c4130-61f6-466a-adbb-f70b3cdaa4b4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3c1c4130-61f6-466a-adbb-f70b3cdaa4b4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf HTTP/1.1 May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:50:52.139193 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:50:52.140828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '1d52913b-ebb2-470d-aafe-129bead9bedf'} May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:50:52.141780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:50:52.143378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:50:52.144726 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3c1c4130-61f6-466a-adbb-f70b3cdaa4b4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:50:52.144726 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3c1c4130-61f6-466a-adbb-f70b3cdaa4b4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 404 len: 111 microversion: 2.1 time: 0.032574 May 27 09:50:52.144726 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 476/940] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:52 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:50:52.151680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b52ee635-67bf-478a-b57f-1ca4f375900f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '.version_select at 0x7fbe375cd160>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:52.221327 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b52ee635-67bf-478a-b57f-1ca4f375900f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-729270524" status: 202 len: 0 microversion: 2.1 time: 0.073406 May 27 09:50:52.222063 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 465/941] 10.222.0.48 () {58 vars in 1217 bytes} [Fri May 27 09:50:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-729270524 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:50:53.069475 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-efc2cb2c-66c5-4bc8-ab86-db98e6d800e1 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: .version_select at 0x7fbe32562040>, body: {"keypair": {"name": "tempest-keypair-32840986", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJaThCBDMapGn+rwiBcqr6nhzAQGIvO++07dx7iaufyRemv/waAXaGokv3ca0i8/p75r2i+SpXonl0q5denrMSrW3gdprMn/0flEV/wyQFdWA4aRtIaZ2i2xVNH/L6/VBg=="}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:53.084308 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-efc2cb2c-66c5-4bc8-ab86-db98e6d800e1 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for project 1b2ae84b95ae44d18119450b94735f03. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:50:53.088207 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-efc2cb2c-66c5-4bc8-ab86-db98e6d800e1 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for user 6772c708b48b404bb9f8794142ec6060 and project 1b2ae84b95ae44d18119450b94735f03. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:50:53.169572 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-efc2cb2c-66c5-4bc8-ab86-db98e6d800e1 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.103805 May 27 09:50:53.170313 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 477/942] 10.222.0.48 () {60 vars in 1158 bytes} [Fri May 27 09:50:53 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:50:55.692137 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-467226648", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "924af2e1-0920-4407-a4e8-e35b1f67efeb"}], "security_groups": [{"name": "tempest-securitygroup--1725824964"}], "key_name": "tempest-keypair-32840986", "user_data": "}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:50:55.802470 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] validate_networks() for [('924af2e1-0920-4407-a4e8-e35b1f67efeb', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:50:56.226739 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:50:56.227166 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:50:56.227644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:50:56.228055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:50:56.228459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:50:56.237750 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:56.238107 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:56.238942 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:56.239378 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:56.256633 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for project 1b2ae84b95ae44d18119450b94735f03. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:50:56.261153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for user 6772c708b48b404bb9f8794142ec6060 and project 1b2ae84b95ae44d18119450b94735f03. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:50:56.274045 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:50:56.276362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:50:56.410992 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-45865a1d-3505-44e8-8c8e-b745b4415576 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723194 May 27 09:50:56.411643 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 466/943] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:50:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:50:56.423344 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-737530ef-b1c1-4b7c-96fc-d17643a9352e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:56.424085 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-737530ef-b1c1-4b7c-96fc-d17643a9352e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:56.483745 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-737530ef-b1c1-4b7c-96fc-d17643a9352e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:56.492381 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-737530ef-b1c1-4b7c-96fc-d17643a9352e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1239 microversion: 2.1 time: 0.074405 May 27 09:50:56.493119 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 478/944] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:56 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1239 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:57.510812 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-14877fb0-8e27-4d9b-82bc-5bf5ca1f8b0d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:57.511417 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-14877fb0-8e27-4d9b-82bc-5bf5ca1f8b0d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:57.518429 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-14877fb0-8e27-4d9b-82bc-5bf5ca1f8b0d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:57.518888 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-14877fb0-8e27-4d9b-82bc-5bf5ca1f8b0d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:57.519664 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-14877fb0-8e27-4d9b-82bc-5bf5ca1f8b0d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:57.520105 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-14877fb0-8e27-4d9b-82bc-5bf5ca1f8b0d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:57.585669 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-14877fb0-8e27-4d9b-82bc-5bf5ca1f8b0d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:57.593416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-14877fb0-8e27-4d9b-82bc-5bf5ca1f8b0d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1243 microversion: 2.1 time: 0.087110 May 27 09:50:57.594316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 467/945] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:57 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1243 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:58.610529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7cab239a-9e65-45cc-b01a-90d6a61ebd3b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:58.611263 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7cab239a-9e65-45cc-b01a-90d6a61ebd3b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:58.618316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7cab239a-9e65-45cc-b01a-90d6a61ebd3b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:58.618801 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7cab239a-9e65-45cc-b01a-90d6a61ebd3b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:58.619640 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7cab239a-9e65-45cc-b01a-90d6a61ebd3b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:58.620083 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7cab239a-9e65-45cc-b01a-90d6a61ebd3b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:58.687127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7cab239a-9e65-45cc-b01a-90d6a61ebd3b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:50:58.695275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7cab239a-9e65-45cc-b01a-90d6a61ebd3b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1299 microversion: 2.1 time: 0.088697 May 27 09:50:58.702305 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 479/946] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:58 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:50:59.716113 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5493d8da-07ca-4e51-b06b-2c9fc45f9586 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:50:59.717329 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5493d8da-07ca-4e51-b06b-2c9fc45f9586 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:50:59.724791 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5493d8da-07ca-4e51-b06b-2c9fc45f9586 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:59.725286 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5493d8da-07ca-4e51-b06b-2c9fc45f9586 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:50:59.726275 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5493d8da-07ca-4e51-b06b-2c9fc45f9586 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:50:59.726864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5493d8da-07ca-4e51-b06b-2c9fc45f9586 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:00.005975 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-5493d8da-07ca-4e51-b06b-2c9fc45f9586 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:00.013625 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5493d8da-07ca-4e51-b06b-2c9fc45f9586 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1365 microversion: 2.1 time: 0.301903 May 27 09:51:00.014216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 468/947] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:50:59 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1365 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:51:00.615165 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-1f035e62-0546-4368-a8a2-f057d4982e0c req-3f7fcd82-48c3-4c4f-acf1-fdfa050a7d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c66bef-7418-40f9-a919-6bb085d2cd51", "tag": "21ad605d-2b06-4a7a-bebf-e99d2fd5be42"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:51:00.626009 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-1f035e62-0546-4368-a8a2-f057d4982e0c req-3f7fcd82-48c3-4c4f-acf1-fdfa050a7d11 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:00.626468 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-1f035e62-0546-4368-a8a2-f057d4982e0c req-3f7fcd82-48c3-4c4f-acf1-fdfa050a7d11 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:00.638650 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-1f035e62-0546-4368-a8a2-f057d4982e0c req-3f7fcd82-48c3-4c4f-acf1-fdfa050a7d11 service nova] Creating event network-changed:21ad605d-2b06-4a7a-bebf-e99d2fd5be42 for instance f9c66bef-7418-40f9-a919-6bb085d2cd51 on hv-cinder-82549 May 27 09:51:00.647436 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-1f035e62-0546-4368-a8a2-f057d4982e0c req-3f7fcd82-48c3-4c4f-acf1-fdfa050a7d11 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036385 May 27 09:51:00.653168 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 480/948] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:51:01.035322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d5c28440-ffd5-462f-94ff-6c126dbd197b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:01.035922 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d5c28440-ffd5-462f-94ff-6c126dbd197b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:01.042809 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5c28440-ffd5-462f-94ff-6c126dbd197b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:01.043254 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5c28440-ffd5-462f-94ff-6c126dbd197b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:01.044026 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5c28440-ffd5-462f-94ff-6c126dbd197b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:01.044847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d5c28440-ffd5-462f-94ff-6c126dbd197b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:01.272572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d5c28440-ffd5-462f-94ff-6c126dbd197b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:01.280287 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d5c28440-ffd5-462f-94ff-6c126dbd197b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1365 microversion: 2.1 time: 0.248860 May 27 09:51:01.281558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 469/949] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:01 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:02.299502 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-285bd836-6bfc-4be5-a1f1-7d5acf59ecf8 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:02.300208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-285bd836-6bfc-4be5-a1f1-7d5acf59ecf8 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:02.306560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-285bd836-6bfc-4be5-a1f1-7d5acf59ecf8 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:02.307013 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-285bd836-6bfc-4be5-a1f1-7d5acf59ecf8 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:02.307781 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-285bd836-6bfc-4be5-a1f1-7d5acf59ecf8 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:02.308221 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-285bd836-6bfc-4be5-a1f1-7d5acf59ecf8 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:02.438658 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-285bd836-6bfc-4be5-a1f1-7d5acf59ecf8 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:02.446119 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-285bd836-6bfc-4be5-a1f1-7d5acf59ecf8 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1365 microversion: 2.1 time: 0.152146 May 27 09:51:02.446715 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 481/950] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:02 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:03.463473 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-fed43599-be43-4d58-87cf-25a468a71d6f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:03.464086 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-fed43599-be43-4d58-87cf-25a468a71d6f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:03.466634 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:03.471769 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fed43599-be43-4d58-87cf-25a468a71d6f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:03.481159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fed43599-be43-4d58-87cf-25a468a71d6f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:03.481159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fed43599-be43-4d58-87cf-25a468a71d6f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:03.481159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-fed43599-be43-4d58-87cf-25a468a71d6f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:03.481159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=91 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:03.605146 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-fed43599-be43-4d58-87cf-25a468a71d6f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:03.612529 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-fed43599-be43-4d58-87cf-25a468a71d6f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1365 microversion: 2.1 time: 0.153063 May 27 09:51:03.613173 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 470/951] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:03 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:04.629475 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d031685e-1bbb-492f-94c9-2adc0db38827 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:04.630038 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d031685e-1bbb-492f-94c9-2adc0db38827 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:04.636505 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d031685e-1bbb-492f-94c9-2adc0db38827 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:04.636950 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d031685e-1bbb-492f-94c9-2adc0db38827 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:04.637705 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d031685e-1bbb-492f-94c9-2adc0db38827 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:04.638139 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d031685e-1bbb-492f-94c9-2adc0db38827 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:04.764720 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d031685e-1bbb-492f-94c9-2adc0db38827 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:04.772675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d031685e-1bbb-492f-94c9-2adc0db38827 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1365 microversion: 2.1 time: 0.147102 May 27 09:51:04.773238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 482/952] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:04 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:05.790459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3b258b89-96ae-415f-9fba-93f9d4e015ed tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:05.791079 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3b258b89-96ae-415f-9fba-93f9d4e015ed tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:05.798885 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3b258b89-96ae-415f-9fba-93f9d4e015ed tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:05.799328 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3b258b89-96ae-415f-9fba-93f9d4e015ed tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:05.800142 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3b258b89-96ae-415f-9fba-93f9d4e015ed tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:05.800567 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3b258b89-96ae-415f-9fba-93f9d4e015ed tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:05.931244 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3b258b89-96ae-415f-9fba-93f9d4e015ed tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:05.939344 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3b258b89-96ae-415f-9fba-93f9d4e015ed tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1365 microversion: 2.1 time: 0.152800 May 27 09:51:05.939909 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 471/953] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:05 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:06.956269 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-44951075-7e1f-4bc1-8b11-d010050bb5a9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:06.956814 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-44951075-7e1f-4bc1-8b11-d010050bb5a9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:06.960265 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=6 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:06.963771 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44951075-7e1f-4bc1-8b11-d010050bb5a9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:06.964212 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44951075-7e1f-4bc1-8b11-d010050bb5a9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:06.964971 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44951075-7e1f-4bc1-8b11-d010050bb5a9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:06.965401 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-44951075-7e1f-4bc1-8b11-d010050bb5a9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:06.968182 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:07.099532 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-44951075-7e1f-4bc1-8b11-d010050bb5a9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:07.106911 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-44951075-7e1f-4bc1-8b11-d010050bb5a9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1365 microversion: 2.1 time: 0.155228 May 27 09:51:07.107482 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 483/954] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:06 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:07.709614 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-a10b30cc-ed73-49bf-8902-226bb578032a req-d79a9f4e-3f6f-4c37-9e1d-31ab3f6e222c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c66bef-7418-40f9-a919-6bb085d2cd51", "name": "network-vif-plugged", "status": "completed", "tag": "21ad605d-2b06-4a7a-bebf-e99d2fd5be42"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:51:07.713207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:07.716663 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=6 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:07.719524 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-a10b30cc-ed73-49bf-8902-226bb578032a req-d79a9f4e-3f6f-4c37-9e1d-31ab3f6e222c service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:07.719985 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-a10b30cc-ed73-49bf-8902-226bb578032a req-d79a9f4e-3f6f-4c37-9e1d-31ab3f6e222c service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:07.730960 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-a10b30cc-ed73-49bf-8902-226bb578032a req-d79a9f4e-3f6f-4c37-9e1d-31ab3f6e222c service nova] Creating event network-vif-plugged:21ad605d-2b06-4a7a-bebf-e99d2fd5be42 for instance f9c66bef-7418-40f9-a919-6bb085d2cd51 on hv-cinder-82549 May 27 09:51:07.736445 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-a10b30cc-ed73-49bf-8902-226bb578032a req-d79a9f4e-3f6f-4c37-9e1d-31ab3f6e222c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030617 May 27 09:51:07.737020 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 472/955] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:51:08.125048 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2d297307-7f9e-4a1b-aefc-f2a987edcf0a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:08.125685 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2d297307-7f9e-4a1b-aefc-f2a987edcf0a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:08.132241 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2d297307-7f9e-4a1b-aefc-f2a987edcf0a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:08.132684 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2d297307-7f9e-4a1b-aefc-f2a987edcf0a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:08.133432 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2d297307-7f9e-4a1b-aefc-f2a987edcf0a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:08.133867 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2d297307-7f9e-4a1b-aefc-f2a987edcf0a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:08.260769 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2d297307-7f9e-4a1b-aefc-f2a987edcf0a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:08.268832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2d297307-7f9e-4a1b-aefc-f2a987edcf0a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1365 microversion: 2.1 time: 0.147980 May 27 09:51:08.269390 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 484/956] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:08 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:09.288038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1cb403b0-be94-419e-9f0a-4def212d87c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:09.288730 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1cb403b0-be94-419e-9f0a-4def212d87c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:09.295982 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1cb403b0-be94-419e-9f0a-4def212d87c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:09.296460 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1cb403b0-be94-419e-9f0a-4def212d87c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:09.297216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1cb403b0-be94-419e-9f0a-4def212d87c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:09.297643 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1cb403b0-be94-419e-9f0a-4def212d87c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:09.427775 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1cb403b0-be94-419e-9f0a-4def212d87c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:09.435739 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1cb403b0-be94-419e-9f0a-4def212d87c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1365 microversion: 2.1 time: 0.153261 May 27 09:51:09.436342 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 473/957] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:09 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:10.453259 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-be6ca088-fbc9-4a77-bd2b-0f5a121f73ee tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:10.453875 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-be6ca088-fbc9-4a77-bd2b-0f5a121f73ee tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:10.456273 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:10.461095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-be6ca088-fbc9-4a77-bd2b-0f5a121f73ee tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:10.461543 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-be6ca088-fbc9-4a77-bd2b-0f5a121f73ee tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:10.462361 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-be6ca088-fbc9-4a77-bd2b-0f5a121f73ee tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:10.462801 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-be6ca088-fbc9-4a77-bd2b-0f5a121f73ee tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:10.593318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-be6ca088-fbc9-4a77-bd2b-0f5a121f73ee tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:10.601382 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-be6ca088-fbc9-4a77-bd2b-0f5a121f73ee tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1555 microversion: 2.1 time: 0.152034 May 27 09:51:10.601939 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 485/958] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:10 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:10.617712 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ce9bfbd1-e583-4481-92f6-bb619724972c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:10.618260 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ce9bfbd1-e583-4481-92f6-bb619724972c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:10.624608 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ce9bfbd1-e583-4481-92f6-bb619724972c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:10.625053 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ce9bfbd1-e583-4481-92f6-bb619724972c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:10.625904 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ce9bfbd1-e583-4481-92f6-bb619724972c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:10.626371 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ce9bfbd1-e583-4481-92f6-bb619724972c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:10.711813 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ce9bfbd1-e583-4481-92f6-bb619724972c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098037 May 27 09:51:10.712409 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 474/959] 10.222.0.48 () {58 vars in 1274 bytes} [Fri May 27 09:51:10 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:51:11.689493 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-f6cb1d9d-7ed5-46c2-9e72-d0e422a2c62d req-f686089c-bf69-4af4-8160-0b0289e5cef5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9c66bef-7418-40f9-a919-6bb085d2cd51", "tag": "21ad605d-2b06-4a7a-bebf-e99d2fd5be42"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:51:11.698085 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-f6cb1d9d-7ed5-46c2-9e72-d0e422a2c62d req-f686089c-bf69-4af4-8160-0b0289e5cef5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:11.698589 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-f6cb1d9d-7ed5-46c2-9e72-d0e422a2c62d req-f686089c-bf69-4af4-8160-0b0289e5cef5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:11.709434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-f6cb1d9d-7ed5-46c2-9e72-d0e422a2c62d req-f686089c-bf69-4af4-8160-0b0289e5cef5 service nova] Creating event network-changed:21ad605d-2b06-4a7a-bebf-e99d2fd5be42 for instance f9c66bef-7418-40f9-a919-6bb085d2cd51 on hv-cinder-82549 May 27 09:51:11.714635 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-f6cb1d9d-7ed5-46c2-9e72-d0e422a2c62d req-f686089c-bf69-4af4-8160-0b0289e5cef5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028761 May 27 09:51:11.715236 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 486/960] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:51:39.172733 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=9 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:39.173625 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=23 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:39.177661 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-06cc4238-062d-4ed0-84af-507c9abcf64e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:51:39.178727 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-06cc4238-062d-4ed0-84af-507c9abcf64e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:39.184544 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-06cc4238-062d-4ed0-84af-507c9abcf64e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:39.185054 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-06cc4238-062d-4ed0-84af-507c9abcf64e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:39.185768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-06cc4238-062d-4ed0-84af-507c9abcf64e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:39.186230 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-06cc4238-062d-4ed0-84af-507c9abcf64e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:39.399807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-06cc4238-062d-4ed0-84af-507c9abcf64e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "POST /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/action" status: 202 len: 0 microversion: 2.1 time: 0.228343 May 27 09:51:39.400513 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 475/961] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:51:39 2022] POST /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:51:39.407151 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=3 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:39.407959 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=19 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:51:39.412048 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-56a14977-ab20-450b-b730-155550cd154d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:39.417825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-56a14977-ab20-450b-b730-155550cd154d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:39.419051 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-56a14977-ab20-450b-b730-155550cd154d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:39.419500 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-56a14977-ab20-450b-b730-155550cd154d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:39.420264 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-56a14977-ab20-450b-b730-155550cd154d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:39.420694 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-56a14977-ab20-450b-b730-155550cd154d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:39.572618 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-56a14977-ab20-450b-b730-155550cd154d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:39.581955 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-56a14977-ab20-450b-b730-155550cd154d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1752 microversion: 2.1 time: 0.176389 May 27 09:51:39.582574 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 487/962] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:39 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1752 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:40.602750 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a4452096-65cf-494f-936b-b4a00443594d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:40.605796 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a4452096-65cf-494f-936b-b4a00443594d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:40.610427 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a4452096-65cf-494f-936b-b4a00443594d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:40.610862 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a4452096-65cf-494f-936b-b4a00443594d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:40.611629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a4452096-65cf-494f-936b-b4a00443594d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:40.612061 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a4452096-65cf-494f-936b-b4a00443594d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:40.899097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-a4452096-65cf-494f-936b-b4a00443594d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:40.910342 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a4452096-65cf-494f-936b-b4a00443594d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.312951 May 27 09:51:40.910923 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 476/963] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:40 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:41.928548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-292bc805-0131-4469-8160-53a520390547 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:41.929096 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-292bc805-0131-4469-8160-53a520390547 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:41.936212 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-292bc805-0131-4469-8160-53a520390547 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:41.936662 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-292bc805-0131-4469-8160-53a520390547 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:41.937421 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-292bc805-0131-4469-8160-53a520390547 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:41.937856 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-292bc805-0131-4469-8160-53a520390547 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:42.078124 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-292bc805-0131-4469-8160-53a520390547 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:42.086104 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-292bc805-0131-4469-8160-53a520390547 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.161629 May 27 09:51:42.086701 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 488/964] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:41 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:43.103236 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f1d33c21-8b1e-4457-82a7-5735ae58a8ac tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:43.103977 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f1d33c21-8b1e-4457-82a7-5735ae58a8ac tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:43.110561 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1d33c21-8b1e-4457-82a7-5735ae58a8ac tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:43.111015 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1d33c21-8b1e-4457-82a7-5735ae58a8ac tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:43.111773 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1d33c21-8b1e-4457-82a7-5735ae58a8ac tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:43.112206 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f1d33c21-8b1e-4457-82a7-5735ae58a8ac tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:43.255866 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f1d33c21-8b1e-4457-82a7-5735ae58a8ac tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:43.264841 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f1d33c21-8b1e-4457-82a7-5735ae58a8ac tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.165435 May 27 09:51:43.269963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 477/965] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:43 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:44.282797 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5f843aa1-9772-47bb-b7c8-65b5524a718d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:44.283412 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5f843aa1-9772-47bb-b7c8-65b5524a718d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:44.290098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5f843aa1-9772-47bb-b7c8-65b5524a718d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:44.290661 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5f843aa1-9772-47bb-b7c8-65b5524a718d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:44.291360 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5f843aa1-9772-47bb-b7c8-65b5524a718d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:44.291798 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5f843aa1-9772-47bb-b7c8-65b5524a718d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:44.488155 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5f843aa1-9772-47bb-b7c8-65b5524a718d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:44.496272 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5f843aa1-9772-47bb-b7c8-65b5524a718d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.217471 May 27 09:51:44.496829 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 489/966] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:44 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:45.513914 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8ae3440e-f469-4e33-8391-a65b4c2b4be3 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:45.514564 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8ae3440e-f469-4e33-8391-a65b4c2b4be3 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:45.521056 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8ae3440e-f469-4e33-8391-a65b4c2b4be3 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:45.521509 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8ae3440e-f469-4e33-8391-a65b4c2b4be3 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:45.522471 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8ae3440e-f469-4e33-8391-a65b4c2b4be3 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:45.522823 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8ae3440e-f469-4e33-8391-a65b4c2b4be3 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:45.668376 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8ae3440e-f469-4e33-8391-a65b4c2b4be3 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:45.676632 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8ae3440e-f469-4e33-8391-a65b4c2b4be3 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.167232 May 27 09:51:45.677192 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 478/967] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:45 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:46.693604 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d931f2e1-04dd-4fef-a9b9-a4699106a7d1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:46.694251 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d931f2e1-04dd-4fef-a9b9-a4699106a7d1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:46.700740 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d931f2e1-04dd-4fef-a9b9-a4699106a7d1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:46.701188 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d931f2e1-04dd-4fef-a9b9-a4699106a7d1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:46.702030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d931f2e1-04dd-4fef-a9b9-a4699106a7d1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:46.702488 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d931f2e1-04dd-4fef-a9b9-a4699106a7d1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:46.843379 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d931f2e1-04dd-4fef-a9b9-a4699106a7d1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:46.851156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d931f2e1-04dd-4fef-a9b9-a4699106a7d1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.161447 May 27 09:51:46.851834 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 490/968] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:46 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:47.869237 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e2f587fd-5487-42e5-a3f9-db4361c43c3d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:47.869820 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e2f587fd-5487-42e5-a3f9-db4361c43c3d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:47.876808 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e2f587fd-5487-42e5-a3f9-db4361c43c3d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:47.877248 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e2f587fd-5487-42e5-a3f9-db4361c43c3d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:47.878016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e2f587fd-5487-42e5-a3f9-db4361c43c3d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:47.878464 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e2f587fd-5487-42e5-a3f9-db4361c43c3d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:48.019604 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e2f587fd-5487-42e5-a3f9-db4361c43c3d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:48.027649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e2f587fd-5487-42e5-a3f9-db4361c43c3d tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.162391 May 27 09:51:48.028222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 479/969] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:47 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:49.045556 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-80e0fdc4-0d0e-4117-abd2-d745c2df2f7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:49.046167 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-80e0fdc4-0d0e-4117-abd2-d745c2df2f7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:49.052387 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-80e0fdc4-0d0e-4117-abd2-d745c2df2f7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:49.052834 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-80e0fdc4-0d0e-4117-abd2-d745c2df2f7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:49.053596 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-80e0fdc4-0d0e-4117-abd2-d745c2df2f7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:49.054030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-80e0fdc4-0d0e-4117-abd2-d745c2df2f7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:49.199880 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-80e0fdc4-0d0e-4117-abd2-d745c2df2f7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:49.208411 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-80e0fdc4-0d0e-4117-abd2-d745c2df2f7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.167382 May 27 09:51:49.212019 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 491/970] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:49 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:50.225007 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-25cdce70-f7ee-4b00-b070-a51b21ea946f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:50.225609 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-25cdce70-f7ee-4b00-b070-a51b21ea946f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:50.232837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-25cdce70-f7ee-4b00-b070-a51b21ea946f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:50.233289 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-25cdce70-f7ee-4b00-b070-a51b21ea946f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:50.234055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-25cdce70-f7ee-4b00-b070-a51b21ea946f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:50.234530 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-25cdce70-f7ee-4b00-b070-a51b21ea946f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:50.381052 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-25cdce70-f7ee-4b00-b070-a51b21ea946f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:50.389603 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-25cdce70-f7ee-4b00-b070-a51b21ea946f tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.168565 May 27 09:51:50.390178 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 480/971] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:50 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:51.405919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9f83e71e-85ee-42f4-85c7-ea14ba846a7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:51.406627 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9f83e71e-85ee-42f4-85c7-ea14ba846a7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:51.413171 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f83e71e-85ee-42f4-85c7-ea14ba846a7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:51.413615 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f83e71e-85ee-42f4-85c7-ea14ba846a7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:51.414399 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f83e71e-85ee-42f4-85c7-ea14ba846a7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:51.414833 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f83e71e-85ee-42f4-85c7-ea14ba846a7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:51.558511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9f83e71e-85ee-42f4-85c7-ea14ba846a7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:51.566892 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9f83e71e-85ee-42f4-85c7-ea14ba846a7a tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.164838 May 27 09:51:51.567472 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 492/972] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:51 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:52.583305 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e6709c8f-4973-411a-951a-22216c184a65 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:52.583813 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e6709c8f-4973-411a-951a-22216c184a65 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:52.590648 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e6709c8f-4973-411a-951a-22216c184a65 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:52.591103 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e6709c8f-4973-411a-951a-22216c184a65 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:52.591877 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e6709c8f-4973-411a-951a-22216c184a65 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:52.592344 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e6709c8f-4973-411a-951a-22216c184a65 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:52.737235 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e6709c8f-4973-411a-951a-22216c184a65 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:52.745331 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e6709c8f-4973-411a-951a-22216c184a65 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.166074 May 27 09:51:52.745897 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 481/973] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:52 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:53.764010 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-474aa4ae-ab33-4113-95de-d649929929cd tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:53.764570 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-474aa4ae-ab33-4113-95de-d649929929cd tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:53.771028 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-474aa4ae-ab33-4113-95de-d649929929cd tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:53.771471 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-474aa4ae-ab33-4113-95de-d649929929cd tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:53.772253 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-474aa4ae-ab33-4113-95de-d649929929cd tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:53.772680 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-474aa4ae-ab33-4113-95de-d649929929cd tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:53.911284 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-474aa4ae-ab33-4113-95de-d649929929cd tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:53.919450 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-474aa4ae-ab33-4113-95de-d649929929cd tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.159942 May 27 09:51:53.920016 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 493/974] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:53 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:54.937615 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-379e1e41-275e-4df5-927c-9b11c8dbc3a8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:54.938156 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-379e1e41-275e-4df5-927c-9b11c8dbc3a8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:54.944710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-379e1e41-275e-4df5-927c-9b11c8dbc3a8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:54.945166 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-379e1e41-275e-4df5-927c-9b11c8dbc3a8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:54.946038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-379e1e41-275e-4df5-927c-9b11c8dbc3a8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:54.946513 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-379e1e41-275e-4df5-927c-9b11c8dbc3a8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:55.089943 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-379e1e41-275e-4df5-927c-9b11c8dbc3a8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:55.098596 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-379e1e41-275e-4df5-927c-9b11c8dbc3a8 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.165602 May 27 09:51:55.099173 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 482/975] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:54 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:56.116575 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-684ea8f2-e5c5-4ff0-bcee-e593054e998c tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:56.117196 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-684ea8f2-e5c5-4ff0-bcee-e593054e998c tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:56.124255 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-684ea8f2-e5c5-4ff0-bcee-e593054e998c tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:56.124706 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-684ea8f2-e5c5-4ff0-bcee-e593054e998c tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:56.125467 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-684ea8f2-e5c5-4ff0-bcee-e593054e998c tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:56.125912 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-684ea8f2-e5c5-4ff0-bcee-e593054e998c tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:56.276399 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-684ea8f2-e5c5-4ff0-bcee-e593054e998c tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:56.284437 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-684ea8f2-e5c5-4ff0-bcee-e593054e998c tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1757 microversion: 2.1 time: 0.171759 May 27 09:51:56.285003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 494/976] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:56 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:51:57.302117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c5959b4a-ecbe-445b-ba10-cc016a1f4b26 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:51:57.302740 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c5959b4a-ecbe-445b-ba10-cc016a1f4b26 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:51:57.308790 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c5959b4a-ecbe-445b-ba10-cc016a1f4b26 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:57.309232 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c5959b4a-ecbe-445b-ba10-cc016a1f4b26 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:57.310041 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c5959b4a-ecbe-445b-ba10-cc016a1f4b26 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:51:57.310501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c5959b4a-ecbe-445b-ba10-cc016a1f4b26 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:51:57.448016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c5959b4a-ecbe-445b-ba10-cc016a1f4b26 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:51:57.456532 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c5959b4a-ecbe-445b-ba10-cc016a1f4b26 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1760 microversion: 2.1 time: 0.158473 May 27 09:51:57.457094 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 483/977] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:51:57 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1760 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:26.757845 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=16 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:26.758581 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=48 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:26.813662 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6f9075f2-9c3c-416a-8adf-5c23c44f0c77 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:26.814159 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6f9075f2-9c3c-416a-8adf-5c23c44f0c77 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:26.820808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f9075f2-9c3c-416a-8adf-5c23c44f0c77 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:26.821189 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f9075f2-9c3c-416a-8adf-5c23c44f0c77 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:26.821943 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f9075f2-9c3c-416a-8adf-5c23c44f0c77 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:26.822411 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6f9075f2-9c3c-416a-8adf-5c23c44f0c77 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:26.846076 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6f9075f2-9c3c-416a-8adf-5c23c44f0c77 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/ips" status: 200 len: 150 microversion: 2.1 time: 0.093658 May 27 09:52:26.846659 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 495/978] 10.222.0.48 () {58 vars in 1247 bytes} [Fri May 27 09:52:26 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/ips => generated 150 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:28.613390 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-dd5ae628-9a40-4143-8445-1507f60e6929 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2"}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:28.617651 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-dd5ae628-9a40-4143-8445-1507f60e6929 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:28.617651 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=18 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:28.617864 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:28.622585 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dd5ae628-9a40-4143-8445-1507f60e6929 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:28.623034 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dd5ae628-9a40-4143-8445-1507f60e6929 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:28.623803 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dd5ae628-9a40-4143-8445-1507f60e6929 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:28.624242 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dd5ae628-9a40-4143-8445-1507f60e6929 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:29.442489 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-dd5ae628-9a40-4143-8445-1507f60e6929 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.833028 May 27 09:52:29.443101 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 484/979] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:52:28 2022] POST /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments => generated 194 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:36.943058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-452ae97e-3b5f-48e6-9c65-38eba7c6b572 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:36.944174 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-452ae97e-3b5f-48e6-9c65-38eba7c6b572 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:36.946644 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:36.947812 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=4 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:36.952472 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-452ae97e-3b5f-48e6-9c65-38eba7c6b572 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:36.952916 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-452ae97e-3b5f-48e6-9c65-38eba7c6b572 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:36.953664 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-452ae97e-3b5f-48e6-9c65-38eba7c6b572 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:36.954224 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-452ae97e-3b5f-48e6-9c65-38eba7c6b572 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:37.041125 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-452ae97e-3b5f-48e6-9c65-38eba7c6b572 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Invalid volume: volume ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2 is already attached to instances: f9c66bef-7418-40f9-a919-6bb085d2cd51 May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-452ae97e-3b5f-48e6-9c65-38eba7c6b572 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: POST /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments HTTP/1.1 May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 74 May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:52:37.042876 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {"volumeAttachment": {"volumeId": "ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2"}} May 27 09:52:37.044825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Invalid volume: volume ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2 is already attached to instances: f9c66bef-7418-40f9-a919-6bb085d2cd51 May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'server_id': 'f9c66bef-7418-40f9-a919-6bb085d2cd51', 'body': {'volumeAttachment': {'volumeId': 'ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2'}}} May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2 is already attached to instances: f9c66bef-7418-40f9-a919-6bb085d2cd51 May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:52:37.045810 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2 is already attached to instances: f9c66bef-7418-40f9-a919-6bb085d2cd51 May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:37.047290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:52:37.048891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:52:37.048891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:52:37.048891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:52:37.048891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2 is already attached to instances: f9c66bef-7418-40f9-a919-6bb085d2cd51 May 27 09:52:37.048891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:52:37.048891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-452ae97e-3b5f-48e6-9c65-38eba7c6b572 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 400 to user: Invalid volume: volume ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2 is already attached to instances: f9c66bef-7418-40f9-a919-6bb085d2cd51 {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:52:37.048891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-452ae97e-3b5f-48e6-9c65-38eba7c6b572 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105666 May 27 09:52:37.048891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 496/980] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:52:36 2022] POST /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments => generated 174 bytes in 107 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 27 09:52:37.109756 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-132e934f-867f-4ec6-8af5-4748ed95e1c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:37.110376 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-132e934f-867f-4ec6-8af5-4748ed95e1c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:37.116636 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-132e934f-867f-4ec6-8af5-4748ed95e1c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:37.117214 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-132e934f-867f-4ec6-8af5-4748ed95e1c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:37.118003 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-132e934f-867f-4ec6-8af5-4748ed95e1c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:37.118459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-132e934f-867f-4ec6-8af5-4748ed95e1c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:37.200360 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-132e934f-867f-4ec6-8af5-4748ed95e1c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lazy-loading 'services' on Instance uuid f9c66bef-7418-40f9-a919-6bb085d2cd51 {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:52:37.432870 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-132e934f-867f-4ec6-8af5-4748ed95e1c4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments/ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2" status: 202 len: 0 microversion: 2.1 time: 0.327751 May 27 09:52:37.433465 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 485/981] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:52:37 2022] DELETE /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments/ff3edbac-ae12-4b78-bf93-d9cb77cfbbe2 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:52:37.441738 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6e14f489-e52d-4a56-9e69-de164790231c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:37.442875 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6e14f489-e52d-4a56-9e69-de164790231c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:37.449406 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6e14f489-e52d-4a56-9e69-de164790231c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:37.449885 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6e14f489-e52d-4a56-9e69-de164790231c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:37.450661 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6e14f489-e52d-4a56-9e69-de164790231c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:37.451089 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6e14f489-e52d-4a56-9e69-de164790231c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:37.479625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6e14f489-e52d-4a56-9e69-de164790231c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041751 May 27 09:52:37.482565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 497/982] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:52:37 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:38.493362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d707042d-fc37-468a-b741-c773ea79c6ae tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:38.494496 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d707042d-fc37-468a-b741-c773ea79c6ae tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:38.501573 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d707042d-fc37-468a-b741-c773ea79c6ae tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:38.502022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d707042d-fc37-468a-b741-c773ea79c6ae tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:38.502821 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d707042d-fc37-468a-b741-c773ea79c6ae tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:38.503253 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d707042d-fc37-468a-b741-c773ea79c6ae tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:38.536311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d707042d-fc37-468a-b741-c773ea79c6ae tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046959 May 27 09:52:38.537796 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 486/983] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:52:38 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:52:38.606076 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1b24a04c-2c0d-43d1-be50-f26cfba0048d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:38.606076 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1b24a04c-2c0d-43d1-be50-f26cfba0048d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:38.615271 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b24a04c-2c0d-43d1-be50-f26cfba0048d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:38.615589 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b24a04c-2c0d-43d1-be50-f26cfba0048d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:38.616397 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b24a04c-2c0d-43d1-be50-f26cfba0048d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:38.616915 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b24a04c-2c0d-43d1-be50-f26cfba0048d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:38.644483 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1b24a04c-2c0d-43d1-be50-f26cfba0048d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:52:38.995698 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1b24a04c-2c0d-43d1-be50-f26cfba0048d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 204 len: 0 microversion: 2.1 time: 0.393668 May 27 09:52:38.996339 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 498/984] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:52:38 2022] DELETE /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 27 09:52:39.007220 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f42f08fa-0953-4506-b478-07bd848f9a14 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:39.008440 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f42f08fa-0953-4506-b478-07bd848f9a14 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:39.017952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f42f08fa-0953-4506-b478-07bd848f9a14 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:39.021490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f42f08fa-0953-4506-b478-07bd848f9a14 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:39.021490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f42f08fa-0953-4506-b478-07bd848f9a14 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:39.021490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f42f08fa-0953-4506-b478-07bd848f9a14 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:39.152145 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f42f08fa-0953-4506-b478-07bd848f9a14 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:39.159674 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f42f08fa-0953-4506-b478-07bd848f9a14 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1680 microversion: 2.1 time: 0.159132 May 27 09:52:39.160243 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 487/985] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:38 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:40.178682 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a4b8f727-7049-4515-8888-9b6b378c7f23 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:40.179430 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a4b8f727-7049-4515-8888-9b6b378c7f23 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:40.186286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a4b8f727-7049-4515-8888-9b6b378c7f23 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:40.186744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a4b8f727-7049-4515-8888-9b6b378c7f23 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:40.187528 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a4b8f727-7049-4515-8888-9b6b378c7f23 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:40.187966 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a4b8f727-7049-4515-8888-9b6b378c7f23 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:40.338832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a4b8f727-7049-4515-8888-9b6b378c7f23 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:40.346614 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a4b8f727-7049-4515-8888-9b6b378c7f23 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1680 microversion: 2.1 time: 0.172150 May 27 09:52:40.347185 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 499/986] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:40 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:41.363735 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-52130246-440b-4b43-9b3a-11fdb1135f32 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:41.364468 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-52130246-440b-4b43-9b3a-11fdb1135f32 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:41.371497 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-52130246-440b-4b43-9b3a-11fdb1135f32 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:41.371948 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-52130246-440b-4b43-9b3a-11fdb1135f32 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:41.372721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-52130246-440b-4b43-9b3a-11fdb1135f32 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:41.373352 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-52130246-440b-4b43-9b3a-11fdb1135f32 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:41.448298 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-52130246-440b-4b43-9b3a-11fdb1135f32 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:41.455986 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-52130246-440b-4b43-9b3a-11fdb1135f32 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1612 microversion: 2.1 time: 0.096211 May 27 09:52:41.456571 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 488/987] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:41 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1612 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:41.679704 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-2d5cc86b-8043-4dbe-a37b-d1fb0679e068 req-4b3cbce8-fb40-4549-be5a-0d287a19e725 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9c66bef-7418-40f9-a919-6bb085d2cd51", "name": "network-vif-deleted", "tag": "21ad605d-2b06-4a7a-bebf-e99d2fd5be42"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:41.688348 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-2d5cc86b-8043-4dbe-a37b-d1fb0679e068 req-4b3cbce8-fb40-4549-be5a-0d287a19e725 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:41.688782 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-2d5cc86b-8043-4dbe-a37b-d1fb0679e068 req-4b3cbce8-fb40-4549-be5a-0d287a19e725 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:41.708650 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-2d5cc86b-8043-4dbe-a37b-d1fb0679e068 req-4b3cbce8-fb40-4549-be5a-0d287a19e725 service nova] Creating event network-vif-deleted:21ad605d-2b06-4a7a-bebf-e99d2fd5be42 for instance f9c66bef-7418-40f9-a919-6bb085d2cd51 on hv-cinder-82549 May 27 09:52:41.714622 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-2d5cc86b-8043-4dbe-a37b-d1fb0679e068 req-4b3cbce8-fb40-4549-be5a-0d287a19e725 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100244 May 27 09:52:41.715395 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 500/988] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:52:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:42.478961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:42.478961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:42.486993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:42.487816 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:42.488980 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:42.489606 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:42.530351 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:42.530768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:42.531638 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lazy-loading 'fault' on Instance uuid f9c66bef-7418-40f9-a919-6bb085d2cd51 {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:52:42.577629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:42.593050 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f171e08f-84a8-4495-b04b-d00aea89c30f tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 200 len: 1329 microversion: 2.1 time: 0.122456 May 27 09:52:42.593635 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 489/989] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:42 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 1329 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:43.611721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8df6f9c0-8cda-4d71-a17a-3d1a48735b5a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:43.612418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8df6f9c0-8cda-4d71-a17a-3d1a48735b5a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:43.620585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8df6f9c0-8cda-4d71-a17a-3d1a48735b5a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:43.621036 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8df6f9c0-8cda-4d71-a17a-3d1a48735b5a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:43.621840 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8df6f9c0-8cda-4d71-a17a-3d1a48735b5a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:43.622312 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8df6f9c0-8cda-4d71-a17a-3d1a48735b5a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:43.636835 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-8df6f9c0-8cda-4d71-a17a-3d1a48735b5a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8df6f9c0-8cda-4d71-a17a-3d1a48735b5a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 HTTP/1.1 May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:52:43.638510 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:52:43.640967 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': 'f9c66bef-7418-40f9-a919-6bb085d2cd51'} May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:52:43.642478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:52:43.644789 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:52:43.646985 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8df6f9c0-8cda-4d71-a17a-3d1a48735b5a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:52:43.646985 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8df6f9c0-8cda-4d71-a17a-3d1a48735b5a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 404 len: 111 microversion: 2.1 time: 0.033332 May 27 09:52:43.646985 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 501/990] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:43 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:52:43.648969 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8d291974-d6a9-4ced-9e57-5d874bd58eac tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '.version_select at 0x7fbe3247e820>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:43.759549 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8d291974-d6a9-4ced-9e57-5d874bd58eac tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-32840986" status: 202 len: 0 microversion: 2.1 time: 0.114255 May 27 09:52:43.760141 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 490/991] 10.222.0.48 () {58 vars in 1214 bytes} [Fri May 27 09:52:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-32840986 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 09:52:44.533002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c7f4870c-913b-441e-9a78-a86d2619ac65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: .version_select at 0x7fbe32579280>, body: {"keypair": {"name": "tempest-keypair-1245814886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0DqPBWhVpdrT0CNMrkQ5r/b7t81oc7xPdWfQ8TvjhVBAK7d8QN8mdFcpdtjr1CgR6RH7puhFz1bz1umbjThfPOlDTLR0AbVhrb+ojgMuWDp/eesgNAzI/oiNkN1HAWkg=="}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:44.547433 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-c7f4870c-913b-441e-9a78-a86d2619ac65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for project 1b2ae84b95ae44d18119450b94735f03. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:52:44.551286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-c7f4870c-913b-441e-9a78-a86d2619ac65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for user 6772c708b48b404bb9f8794142ec6060 and project 1b2ae84b95ae44d18119450b94735f03. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:52:44.647234 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c7f4870c-913b-441e-9a78-a86d2619ac65 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.118028 May 27 09:52:44.647861 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 502/992] 10.222.0.48 () {60 vars in 1158 bytes} [Fri May 27 09:52:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:46.943650 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1423827636", "imageRef": "85d54ff9-07dd-4700-acce-fee4244b3032", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "924af2e1-0920-4407-a4e8-e35b1f67efeb"}], "security_groups": [{"name": "tempest-securitygroup--256779097"}], "key_name": "tempest-keypair-1245814886", "user_data": "}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:47.051641 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] validate_networks() for [('924af2e1-0920-4407-a4e8-e35b1f67efeb', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:52:47.431884 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:52:47.432299 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:52:47.432766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:52:47.433168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:52:47.433572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:52:47.443005 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:47.443454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:47.444258 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:47.444700 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:47.462278 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for project 1b2ae84b95ae44d18119450b94735f03. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:52:47.466950 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Getting quotas for user 6772c708b48b404bb9f8794142ec6060 and project 1b2ae84b95ae44d18119450b94735f03. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:52:47.478620 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:52:47.480961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='85d54ff9-07dd-4700-acce-fee4244b3032',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:52:47.597342 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d9ed9e3e-e2c7-479a-a02f-f2c67889be69 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.657976 May 27 09:52:47.598165 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 491/993] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:52:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:52:47.608512 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a0d52a8e-38b0-4457-b2e4-3aa54f0587c9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:47.609133 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a0d52a8e-38b0-4457-b2e4-3aa54f0587c9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:47.663553 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a0d52a8e-38b0-4457-b2e4-3aa54f0587c9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:47.670733 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a0d52a8e-38b0-4457-b2e4-3aa54f0587c9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1242 microversion: 2.1 time: 0.066665 May 27 09:52:47.671994 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 503/994] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:47 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:48.689295 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-17b6862c-3327-424a-9851-df73070c968e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:48.689850 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-17b6862c-3327-424a-9851-df73070c968e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:48.696654 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-17b6862c-3327-424a-9851-df73070c968e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:48.697101 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-17b6862c-3327-424a-9851-df73070c968e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:48.697862 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-17b6862c-3327-424a-9851-df73070c968e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:48.698330 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-17b6862c-3327-424a-9851-df73070c968e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:48.759236 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-17b6862c-3327-424a-9851-df73070c968e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:48.767021 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-17b6862c-3327-424a-9851-df73070c968e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1246 microversion: 2.1 time: 0.082160 May 27 09:52:48.767497 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 492/995] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:48 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:49.784448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3ad36ad5-5dbc-4090-a17c-6665530c4e9a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:49.785339 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3ad36ad5-5dbc-4090-a17c-6665530c4e9a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:49.792916 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ad36ad5-5dbc-4090-a17c-6665530c4e9a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:49.793631 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ad36ad5-5dbc-4090-a17c-6665530c4e9a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:49.794597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ad36ad5-5dbc-4090-a17c-6665530c4e9a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:49.795085 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ad36ad5-5dbc-4090-a17c-6665530c4e9a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:49.861548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3ad36ad5-5dbc-4090-a17c-6665530c4e9a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:49.869016 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3ad36ad5-5dbc-4090-a17c-6665530c4e9a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1302 microversion: 2.1 time: 0.088689 May 27 09:52:49.869580 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 504/996] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:49 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:50.886217 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9e2273ec-16b0-4d47-8a95-fe7117eaf5ce tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:50.886839 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9e2273ec-16b0-4d47-8a95-fe7117eaf5ce tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:50.893314 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9e2273ec-16b0-4d47-8a95-fe7117eaf5ce tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:50.893766 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9e2273ec-16b0-4d47-8a95-fe7117eaf5ce tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:50.894584 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9e2273ec-16b0-4d47-8a95-fe7117eaf5ce tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:50.895030 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9e2273ec-16b0-4d47-8a95-fe7117eaf5ce tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:51.100913 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9e2273ec-16b0-4d47-8a95-fe7117eaf5ce tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:51.111441 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9e2273ec-16b0-4d47-8a95-fe7117eaf5ce tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1367 microversion: 2.1 time: 0.229024 May 27 09:52:51.112381 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 493/997] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:50 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:52:51.358148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-28d583ba-c8e8-4ec4-a17e-87b001f2adb8 req-830ab551-833c-4beb-b310-988cae18681e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c2294d-dd65-4bca-8557-e7652982099b", "tag": "78424066-9f6d-4f5e-b4ef-68913a80624f"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:51.367313 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-28d583ba-c8e8-4ec4-a17e-87b001f2adb8 req-830ab551-833c-4beb-b310-988cae18681e service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:51.367824 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-28d583ba-c8e8-4ec4-a17e-87b001f2adb8 req-830ab551-833c-4beb-b310-988cae18681e service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:51.379798 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-28d583ba-c8e8-4ec4-a17e-87b001f2adb8 req-830ab551-833c-4beb-b310-988cae18681e service nova] Creating event network-changed:78424066-9f6d-4f5e-b4ef-68913a80624f for instance d6c2294d-dd65-4bca-8557-e7652982099b on hv-cinder-82549 May 27 09:52:51.385858 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-28d583ba-c8e8-4ec4-a17e-87b001f2adb8 req-830ab551-833c-4beb-b310-988cae18681e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034057 May 27 09:52:51.386521 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 505/998] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:52.129062 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-482d5fe4-06de-4746-a306-f5bf37289dd4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:52.129655 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-482d5fe4-06de-4746-a306-f5bf37289dd4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:52.136157 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-482d5fe4-06de-4746-a306-f5bf37289dd4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:52.136600 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-482d5fe4-06de-4746-a306-f5bf37289dd4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:52.137362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-482d5fe4-06de-4746-a306-f5bf37289dd4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:52.137792 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-482d5fe4-06de-4746-a306-f5bf37289dd4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:52.341232 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-482d5fe4-06de-4746-a306-f5bf37289dd4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:52.349128 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-482d5fe4-06de-4746-a306-f5bf37289dd4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1367 microversion: 2.1 time: 0.223804 May 27 09:52:52.350009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 494/999] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:52 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:53.370806 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9c938756-9a55-46ce-b242-fabfba4dd327 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:53.371519 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9c938756-9a55-46ce-b242-fabfba4dd327 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:53.377865 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9c938756-9a55-46ce-b242-fabfba4dd327 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:53.378352 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9c938756-9a55-46ce-b242-fabfba4dd327 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:53.379122 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9c938756-9a55-46ce-b242-fabfba4dd327 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:53.379564 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9c938756-9a55-46ce-b242-fabfba4dd327 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:53.508309 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9c938756-9a55-46ce-b242-fabfba4dd327 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:53.515827 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9c938756-9a55-46ce-b242-fabfba4dd327 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1367 microversion: 2.1 time: 0.150419 May 27 09:52:53.516389 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 506/1000] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:53 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:54.532763 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-920c31c8-0db6-4a12-8005-f5ebceade506 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:54.533400 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-920c31c8-0db6-4a12-8005-f5ebceade506 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:54.540050 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-920c31c8-0db6-4a12-8005-f5ebceade506 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:54.540494 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-920c31c8-0db6-4a12-8005-f5ebceade506 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:54.541260 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-920c31c8-0db6-4a12-8005-f5ebceade506 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:54.541691 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-920c31c8-0db6-4a12-8005-f5ebceade506 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:54.668533 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-920c31c8-0db6-4a12-8005-f5ebceade506 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:54.675878 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-920c31c8-0db6-4a12-8005-f5ebceade506 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1367 microversion: 2.1 time: 0.147023 May 27 09:52:54.676437 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 495/1001] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:54 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:55.693745 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-95ffea50-14d1-4d6d-8e4b-8e3e9ab57735 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:55.694447 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-95ffea50-14d1-4d6d-8e4b-8e3e9ab57735 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:55.701438 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-95ffea50-14d1-4d6d-8e4b-8e3e9ab57735 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:55.701886 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-95ffea50-14d1-4d6d-8e4b-8e3e9ab57735 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:55.702666 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-95ffea50-14d1-4d6d-8e4b-8e3e9ab57735 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:55.703105 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-95ffea50-14d1-4d6d-8e4b-8e3e9ab57735 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:55.830573 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-95ffea50-14d1-4d6d-8e4b-8e3e9ab57735 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:55.838063 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-95ffea50-14d1-4d6d-8e4b-8e3e9ab57735 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1367 microversion: 2.1 time: 0.148368 May 27 09:52:55.839281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 507/1002] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:55 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:56.856121 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-045354f6-2e86-4851-96b1-5d3249f4ba83 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:56.856740 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-045354f6-2e86-4851-96b1-5d3249f4ba83 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:56.863126 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-045354f6-2e86-4851-96b1-5d3249f4ba83 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:56.863574 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-045354f6-2e86-4851-96b1-5d3249f4ba83 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:56.864331 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-045354f6-2e86-4851-96b1-5d3249f4ba83 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:56.864768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-045354f6-2e86-4851-96b1-5d3249f4ba83 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:56.999195 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-045354f6-2e86-4851-96b1-5d3249f4ba83 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:57.006658 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-045354f6-2e86-4851-96b1-5d3249f4ba83 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1367 microversion: 2.1 time: 0.154920 May 27 09:52:57.007227 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 496/1003] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:56 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:58.023930 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-7e2c0f6f-eb01-4c6d-86ba-d3d953e05d3e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:58.024540 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-7e2c0f6f-eb01-4c6d-86ba-d3d953e05d3e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:58.026992 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=6 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:58.031832 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7e2c0f6f-eb01-4c6d-86ba-d3d953e05d3e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:58.032276 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7e2c0f6f-eb01-4c6d-86ba-d3d953e05d3e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:58.033036 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7e2c0f6f-eb01-4c6d-86ba-d3d953e05d3e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:58.033473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-7e2c0f6f-eb01-4c6d-86ba-d3d953e05d3e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:58.166444 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-7e2c0f6f-eb01-4c6d-86ba-d3d953e05d3e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:58.175480 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-7e2c0f6f-eb01-4c6d-86ba-d3d953e05d3e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1367 microversion: 2.1 time: 0.155463 May 27 09:52:58.176062 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 508/1004] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:58 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:52:58.360647 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-6080d1cd-eb44-4dde-a408-1f72ff0b5114 req-ca534785-17f0-46f8-98fe-ac9ecd5eb082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c2294d-dd65-4bca-8557-e7652982099b", "name": "network-vif-plugged", "status": "completed", "tag": "78424066-9f6d-4f5e-b4ef-68913a80624f"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:52:58.366338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:58.366338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=6 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:52:58.370773 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-6080d1cd-eb44-4dde-a408-1f72ff0b5114 req-ca534785-17f0-46f8-98fe-ac9ecd5eb082 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:58.371220 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-6080d1cd-eb44-4dde-a408-1f72ff0b5114 req-ca534785-17f0-46f8-98fe-ac9ecd5eb082 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:58.383207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-6080d1cd-eb44-4dde-a408-1f72ff0b5114 req-ca534785-17f0-46f8-98fe-ac9ecd5eb082 service nova] Creating event network-vif-plugged:78424066-9f6d-4f5e-b4ef-68913a80624f for instance d6c2294d-dd65-4bca-8557-e7652982099b on hv-cinder-82549 May 27 09:52:58.388343 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-6080d1cd-eb44-4dde-a408-1f72ff0b5114 req-ca534785-17f0-46f8-98fe-ac9ecd5eb082 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031395 May 27 09:52:58.389017 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 497/1005] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:52:59.197424 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-6a4a4868-8d5d-4c19-b385-d950f201517d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:52:59.199067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-6a4a4868-8d5d-4c19-b385-d950f201517d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:52:59.207124 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a4a4868-8d5d-4c19-b385-d950f201517d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:59.207594 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a4a4868-8d5d-4c19-b385-d950f201517d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:59.208354 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a4a4868-8d5d-4c19-b385-d950f201517d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:52:59.208780 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-6a4a4868-8d5d-4c19-b385-d950f201517d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:52:59.338082 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-6a4a4868-8d5d-4c19-b385-d950f201517d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:52:59.345533 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-6a4a4868-8d5d-4c19-b385-d950f201517d tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1367 microversion: 2.1 time: 0.155554 May 27 09:52:59.346095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 509/1006] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:52:59 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:53:00.364731 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2bf3de85-3118-47c6-97d8-ef640160c679 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:00.365380 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2bf3de85-3118-47c6-97d8-ef640160c679 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:00.367991 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:00.373398 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bf3de85-3118-47c6-97d8-ef640160c679 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:00.373844 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bf3de85-3118-47c6-97d8-ef640160c679 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:00.374648 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bf3de85-3118-47c6-97d8-ef640160c679 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:00.375087 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bf3de85-3118-47c6-97d8-ef640160c679 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:00.379241 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:00.505168 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2bf3de85-3118-47c6-97d8-ef640160c679 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:53:00.513339 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2bf3de85-3118-47c6-97d8-ef640160c679 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1367 microversion: 2.1 time: 0.153432 May 27 09:53:00.513911 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 498/1007] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:53:00 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:53:01.411957 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8ce49b3d-525d-4b69-a54f-1687616e2f66 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1927724784"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:53:01.412552 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8ce49b3d-525d-4b69-a54f-1687616e2f66 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:01.419803 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8ce49b3d-525d-4b69-a54f-1687616e2f66 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:01.420246 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8ce49b3d-525d-4b69-a54f-1687616e2f66 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:01.420997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8ce49b3d-525d-4b69-a54f-1687616e2f66 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:01.421429 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8ce49b3d-525d-4b69-a54f-1687616e2f66 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:01.531101 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8293ebeb-0fc8-4b42-b9b3-f3a1332c8d82 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:01.531691 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8293ebeb-0fc8-4b42-b9b3-f3a1332c8d82 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:01.542621 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8293ebeb-0fc8-4b42-b9b3-f3a1332c8d82 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:01.542621 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8293ebeb-0fc8-4b42-b9b3-f3a1332c8d82 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:01.542621 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8293ebeb-0fc8-4b42-b9b3-f3a1332c8d82 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:01.542621 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8293ebeb-0fc8-4b42-b9b3-f3a1332c8d82 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:01.549900 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.network.security_group_api [None req-8ce49b3d-525d-4b69-a54f-1687616e2f66 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Removing security group 9e79336e-9a87-4118-8813-5923c5d50537 from port 4c3ba279-e102-4d82-82bf-7258d5f7c7c1 May 27 09:53:01.675700 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8293ebeb-0fc8-4b42-b9b3-f3a1332c8d82 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:53:01.683128 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8293ebeb-0fc8-4b42-b9b3-f3a1332c8d82 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1558 microversion: 2.1 time: 0.156907 May 27 09:53:01.683693 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 499/1008] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:53:01 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:53:01.700112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1e2acd98-cbca-4a87-9588-ff7fe23ae45c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:01.700603 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1e2acd98-cbca-4a87-9588-ff7fe23ae45c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:01.706628 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1e2acd98-cbca-4a87-9588-ff7fe23ae45c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:01.707072 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1e2acd98-cbca-4a87-9588-ff7fe23ae45c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:01.707830 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1e2acd98-cbca-4a87-9588-ff7fe23ae45c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:01.708256 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1e2acd98-cbca-4a87-9588-ff7fe23ae45c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:01.785319 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1e2acd98-cbca-4a87-9588-ff7fe23ae45c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089545 May 27 09:53:01.785916 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 500/1009] 10.222.0.48 () {58 vars in 1274 bytes} [Fri May 27 09:53:01 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 09:53:01.977658 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8ce49b3d-525d-4b69-a54f-1687616e2f66 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "POST /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/action" status: 202 len: 0 microversion: 2.1 time: 0.568540 May 27 09:53:01.979491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 510/1010] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:53:01 2022] POST /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/action => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:53:01.991611 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-0fef38e5-8f2e-483e-95fd-04eb300db983 req-bad8c022-08ba-4c5f-bc09-5db718ea6420 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b83df12-67ab-4003-bdb5-f2be8c59c517", "tag": "4c3ba279-e102-4d82-82bf-7258d5f7c7c1"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:53:02.009779 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-0fef38e5-8f2e-483e-95fd-04eb300db983 req-bad8c022-08ba-4c5f-bc09-5db718ea6420 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:02.012939 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-0fef38e5-8f2e-483e-95fd-04eb300db983 req-bad8c022-08ba-4c5f-bc09-5db718ea6420 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:02.028063 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-0fef38e5-8f2e-483e-95fd-04eb300db983 req-bad8c022-08ba-4c5f-bc09-5db718ea6420 service nova] Creating event network-changed:4c3ba279-e102-4d82-82bf-7258d5f7c7c1 for instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 on hv-cinder-82549 May 27 09:53:02.034979 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-0fef38e5-8f2e-483e-95fd-04eb300db983 req-bad8c022-08ba-4c5f-bc09-5db718ea6420 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050632 May 27 09:53:02.035987 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 501/1011] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:53:03.258870 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-f51bb5c3-869c-4571-97f1-4c53da9c31d3 req-5c5b095d-d707-47cb-84a9-a604a559ea5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6c2294d-dd65-4bca-8557-e7652982099b", "tag": "78424066-9f6d-4f5e-b4ef-68913a80624f"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:53:03.268103 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-f51bb5c3-869c-4571-97f1-4c53da9c31d3 req-5c5b095d-d707-47cb-84a9-a604a559ea5f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:03.268556 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-f51bb5c3-869c-4571-97f1-4c53da9c31d3 req-5c5b095d-d707-47cb-84a9-a604a559ea5f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:03.280913 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-f51bb5c3-869c-4571-97f1-4c53da9c31d3 req-5c5b095d-d707-47cb-84a9-a604a559ea5f service nova] Creating event network-changed:78424066-9f6d-4f5e-b4ef-68913a80624f for instance d6c2294d-dd65-4bca-8557-e7652982099b on hv-cinder-82549 May 27 09:53:03.286066 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-f51bb5c3-869c-4571-97f1-4c53da9c31d3 req-5c5b095d-d707-47cb-84a9-a604a559ea5f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030704 May 27 09:53:03.286706 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 511/1012] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:53:03.561452 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2b0faa57-70ec-48e0-8a28-3f6197719bb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:03.562739 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2b0faa57-70ec-48e0-8a28-3f6197719bb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:03.578426 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2b0faa57-70ec-48e0-8a28-3f6197719bb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:03.579192 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2b0faa57-70ec-48e0-8a28-3f6197719bb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:03.579938 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2b0faa57-70ec-48e0-8a28-3f6197719bb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:03.580530 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2b0faa57-70ec-48e0-8a28-3f6197719bb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:03.679144 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-2b0faa57-70ec-48e0-8a28-3f6197719bb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lazy-loading 'services' on Instance uuid 0b83df12-67ab-4003-bdb5-f2be8c59c517 {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:53:03.927090 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2b0faa57-70ec-48e0-8a28-3f6197719bb6 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments/5a391400-77f2-4dd2-aa80-828e3707603e" status: 202 len: 0 microversion: 2.1 time: 0.369807 May 27 09:53:03.927887 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 502/1013] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:53:03 2022] DELETE /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments/5a391400-77f2-4dd2-aa80-828e3707603e => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:53:03.938714 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-26c7553e-2eaf-4b7c-96e7-3d176be00553 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:03.940134 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-26c7553e-2eaf-4b7c-96e7-3d176be00553 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:03.947479 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-26c7553e-2eaf-4b7c-96e7-3d176be00553 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:03.948325 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-26c7553e-2eaf-4b7c-96e7-3d176be00553 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:03.949324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-26c7553e-2eaf-4b7c-96e7-3d176be00553 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:03.949956 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-26c7553e-2eaf-4b7c-96e7-3d176be00553 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:03.983472 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-26c7553e-2eaf-4b7c-96e7-3d176be00553 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049775 May 27 09:53:03.984451 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 512/1014] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:53:03 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:53:04.051926 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-48ec7499-4bfc-409f-9163-e8f9b96ad33a req-387a983c-8a6b-426a-98e0-7e074a7defe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b83df12-67ab-4003-bdb5-f2be8c59c517", "tag": "4c3ba279-e102-4d82-82bf-7258d5f7c7c1"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:53:04.061570 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-48ec7499-4bfc-409f-9163-e8f9b96ad33a req-387a983c-8a6b-426a-98e0-7e074a7defe7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:04.062680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-48ec7499-4bfc-409f-9163-e8f9b96ad33a req-387a983c-8a6b-426a-98e0-7e074a7defe7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:04.075608 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-48ec7499-4bfc-409f-9163-e8f9b96ad33a req-387a983c-8a6b-426a-98e0-7e074a7defe7 service nova] Creating event network-changed:4c3ba279-e102-4d82-82bf-7258d5f7c7c1 for instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 on hv-cinder-82549 May 27 09:53:04.082140 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-48ec7499-4bfc-409f-9163-e8f9b96ad33a req-387a983c-8a6b-426a-98e0-7e074a7defe7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034140 May 27 09:53:04.083416 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 503/1015] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:53:04.996331 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-beecd01e-2645-44df-824a-49f585ffc9a1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:04.997248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-beecd01e-2645-44df-824a-49f585ffc9a1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:05.003854 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-beecd01e-2645-44df-824a-49f585ffc9a1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:05.004307 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-beecd01e-2645-44df-824a-49f585ffc9a1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:05.005113 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-beecd01e-2645-44df-824a-49f585ffc9a1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:05.005543 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-beecd01e-2645-44df-824a-49f585ffc9a1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:05.035036 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-beecd01e-2645-44df-824a-49f585ffc9a1 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043333 May 27 09:53:05.035771 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 513/1016] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:53:04 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:53:05.047074 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a13b07ab-1fd5-4456-86f0-fe96b5177717 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:05.047747 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-a13b07ab-1fd5-4456-86f0-fe96b5177717 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:05.054613 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a13b07ab-1fd5-4456-86f0-fe96b5177717 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:05.055158 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a13b07ab-1fd5-4456-86f0-fe96b5177717 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:05.056158 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a13b07ab-1fd5-4456-86f0-fe96b5177717 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:05.056600 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-a13b07ab-1fd5-4456-86f0-fe96b5177717 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:05.135363 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-a13b07ab-1fd5-4456-86f0-fe96b5177717 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] HTTP exception thrown: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 is not attached to volume 5a391400-77f2-4dd2-aa80-828e3707603e May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a13b07ab-1fd5-4456-86f0-fe96b5177717 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Request method failure captured: May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: DELETE /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments/5a391400-77f2-4dd2-aa80-828e3707603e HTTP/1.1 May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJ6zWUG4Ty3zmCPDAmJZ-77n21ecc9ezHz62df8G2Kbbai8ZLOIxsValvYquTQWSNgbHVIxIadc2PQ7pLwS-p7nwUoo_HJ_pcR5LVAjkg4EADdD8nQstsiSzt2YiVNIfGMOVRKsFC8F5j-wWQL5KYJBxqDdnHahj_BeHhlefGzvTAw4 May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: c8c6682d39b441fd9d58defd883f3e9a May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-TestMinimumBasicScenario-1335915053 May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:53:05.148316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8c6682d39b441fd9d58defd883f3e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c6682d39b441fd9d58defd883f3e9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c6682d39b441fd9d58defd883f3e9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8c6682d39b441fd9d58defd883f3e9a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-TestMinimumBasicScenario-1335915053 May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: c8c6682d39b441fd9d58defd883f3e9a May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1335915053 May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-TestMinimumBasicScenario-1335915053-project May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 25b3c1ea6b294c12a678d746cd46c72d May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-TestMinimumBasicScenario-1335915053-project May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:53:05.150027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 is not attached to volume 5a391400-77f2-4dd2-aa80-828e3707603e May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'server_id': '0b83df12-67ab-4003-bdb5-f2be8c59c517', 'id': '5a391400-77f2-4dd2-aa80-828e3707603e'} May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5a391400-77f2-4dd2-aa80-828e3707603e. May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:53:05.150895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 is not attached to volume 5a391400-77f2-4dd2-aa80-828e3707603e May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 is not attached to volume 5a391400-77f2-4dd2-aa80-828e3707603e May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:53:05.152154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-a13b07ab-1fd5-4456-86f0-fe96b5177717 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Returning 404 to user: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 is not attached to volume 5a391400-77f2-4dd2-aa80-828e3707603e {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:53:05.153112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-a13b07ab-1fd5-4456-86f0-fe96b5177717 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments/5a391400-77f2-4dd2-aa80-828e3707603e" status: 404 len: 154 microversion: 2.1 time: 0.108044 May 27 09:53:05.153112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 504/1017] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:53:05 2022] DELETE /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517/os-volume_attachments/5a391400-77f2-4dd2-aa80-828e3707603e => generated 154 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:53:06.450912 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5453daa6-a002-445b-a148-d625d40c2c17 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:06.451451 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5453daa6-a002-445b-a148-d625d40c2c17 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:06.457963 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5453daa6-a002-445b-a148-d625d40c2c17 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:06.458456 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5453daa6-a002-445b-a148-d625d40c2c17 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:06.459217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5453daa6-a002-445b-a148-d625d40c2c17 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:06.459657 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5453daa6-a002-445b-a148-d625d40c2c17 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:06.484321 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5453daa6-a002-445b-a148-d625d40c2c17 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:53:06.517394 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:06.851270 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5453daa6-a002-445b-a148-d625d40c2c17 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 204 len: 0 microversion: 2.1 time: 0.403884 May 27 09:53:06.851982 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 514/1018] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:53:06 2022] DELETE /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:53:06.860828 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2259d981-c18b-44f4-9ab9-22ba001f0788 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:06.861517 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2259d981-c18b-44f4-9ab9-22ba001f0788 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:06.868033 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2259d981-c18b-44f4-9ab9-22ba001f0788 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:06.868472 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2259d981-c18b-44f4-9ab9-22ba001f0788 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:06.869226 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2259d981-c18b-44f4-9ab9-22ba001f0788 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:06.869653 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2259d981-c18b-44f4-9ab9-22ba001f0788 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:07.000019 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2259d981-c18b-44f4-9ab9-22ba001f0788 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:53:07.007651 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2259d981-c18b-44f4-9ab9-22ba001f0788 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1554 microversion: 2.1 time: 0.150806 May 27 09:53:07.008225 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 505/1019] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:53:06 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:53:08.025506 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-34cac032-58db-44a8-9cb7-ce31982127c5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:08.026748 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-34cac032-58db-44a8-9cb7-ce31982127c5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:08.029160 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:53:08.033896 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-34cac032-58db-44a8-9cb7-ce31982127c5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:08.034388 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-34cac032-58db-44a8-9cb7-ce31982127c5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:08.035160 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-34cac032-58db-44a8-9cb7-ce31982127c5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:08.035659 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-34cac032-58db-44a8-9cb7-ce31982127c5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:08.163707 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-34cac032-58db-44a8-9cb7-ce31982127c5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:53:08.172197 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-34cac032-58db-44a8-9cb7-ce31982127c5 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1554 microversion: 2.1 time: 0.150953 May 27 09:53:08.172755 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 515/1020] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:53:08 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:53:09.189556 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9a0e8239-71ee-4e70-b441-d9b3442207df tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:09.190126 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9a0e8239-71ee-4e70-b441-d9b3442207df tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:09.196841 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a0e8239-71ee-4e70-b441-d9b3442207df tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:09.197286 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a0e8239-71ee-4e70-b441-d9b3442207df tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:09.198049 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a0e8239-71ee-4e70-b441-d9b3442207df tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:09.198505 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9a0e8239-71ee-4e70-b441-d9b3442207df tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:09.397285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9a0e8239-71ee-4e70-b441-d9b3442207df tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25b3c1ea6b294c12a678d746cd46c72d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8c6682d39b441fd9d58defd883f3e9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:53:09.404968 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9a0e8239-71ee-4e70-b441-d9b3442207df tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 200 len: 1554 microversion: 2.1 time: 0.219321 May 27 09:53:09.406077 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 506/1021] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:53:09 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 1554 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:53:09.427922 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-22aa2ea5-5d11-424e-8f5c-c4318822c92e req-37e8cbb3-ce76-439c-b3dd-bd3ac59a2e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b83df12-67ab-4003-bdb5-f2be8c59c517", "name": "network-vif-deleted", "tag": "4c3ba279-e102-4d82-82bf-7258d5f7c7c1"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:53:09.443368 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-22aa2ea5-5d11-424e-8f5c-c4318822c92e req-37e8cbb3-ce76-439c-b3dd-bd3ac59a2e22 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:09.443368 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-22aa2ea5-5d11-424e-8f5c-c4318822c92e req-37e8cbb3-ce76-439c-b3dd-bd3ac59a2e22 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:09.451610 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-22aa2ea5-5d11-424e-8f5c-c4318822c92e req-37e8cbb3-ce76-439c-b3dd-bd3ac59a2e22 service nova] Creating event network-vif-deleted:4c3ba279-e102-4d82-82bf-7258d5f7c7c1 for instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 on hv-cinder-82549 May 27 09:53:09.456401 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-22aa2ea5-5d11-424e-8f5c-c4318822c92e req-37e8cbb3-ce76-439c-b3dd-bd3ac59a2e22 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032614 May 27 09:53:09.457047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 516/1022] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:53:10.423078 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-648e0019-d450-452b-a695-fbde6c0ec279 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:10.423605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-648e0019-d450-452b-a695-fbde6c0ec279 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] [instance: 0b83df12-67ab-4003-bdb5-f2be8c59c517] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:53:10.429891 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-648e0019-d450-452b-a695-fbde6c0ec279 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:10.430365 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-648e0019-d450-452b-a695-fbde6c0ec279 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:10.431122 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-648e0019-d450-452b-a695-fbde6c0ec279 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:53:10.431553 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-648e0019-d450-452b-a695-fbde6c0ec279 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:53:10.445428 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-648e0019-d450-452b-a695-fbde6c0ec279 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] HTTP exception thrown: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 could not be found. May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-648e0019-d450-452b-a695-fbde6c0ec279 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Request method failure captured: May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 HTTP/1.1 May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJ6zWUG4Ty3zmCPDAmJZ-77n21ecc9ezHz62df8G2Kbbai8ZLOIxsValvYquTQWSNgbHVIxIadc2PQ7pLwS-p7nwUoo_HJ_pcR5LVAjkg4EADdD8nQstsiSzt2YiVNIfGMOVRKsFC8F5j-wWQL5KYJBxqDdnHahj_BeHhlefGzvTAw4 May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: c8c6682d39b441fd9d58defd883f3e9a May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-TestMinimumBasicScenario-1335915053 May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:53:10.446996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c8c6682d39b441fd9d58defd883f3e9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c6682d39b441fd9d58defd883f3e9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c8c6682d39b441fd9d58defd883f3e9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c8c6682d39b441fd9d58defd883f3e9a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-TestMinimumBasicScenario-1335915053 May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: c8c6682d39b441fd9d58defd883f3e9a May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1335915053 May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-TestMinimumBasicScenario-1335915053-project May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 25b3c1ea6b294c12a678d746cd46c72d May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-TestMinimumBasicScenario-1335915053-project May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 could not be found. May 27 09:53:10.449347 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '0b83df12-67ab-4003-bdb5-f2be8c59c517'} May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 could not be found. May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:53:10.450337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 could not be found. May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 could not be found. May 27 09:53:10.451999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:53:10.453555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-648e0019-d450-452b-a695-fbde6c0ec279 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Returning 404 to user: Instance 0b83df12-67ab-4003-bdb5-f2be8c59c517 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:53:10.453555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-648e0019-d450-452b-a695-fbde6c0ec279 tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517" status: 404 len: 111 microversion: 2.1 time: 0.029382 May 27 09:53:10.453555 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 507/1023] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:53:10 2022] GET /compute/v2.1/servers/0b83df12-67ab-4003-bdb5-f2be8c59c517 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:53:10.458981 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9174af52-a3ff-4840-876b-52fab6b4155e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] Calling method '.version_select at 0x7fbe3238cc10>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:53:10.612369 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9174af52-a3ff-4840-876b-52fab6b4155e tempest-TestMinimumBasicScenario-1335915053 tempest-TestMinimumBasicScenario-1335915053-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-924590235" status: 202 len: 0 microversion: 2.1 time: 0.158047 May 27 09:53:10.612961 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 517/1024] 10.222.0.48 () {58 vars in 1268 bytes} [Fri May 27 09:53:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-924590235 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:53:23.636465 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:53:23.637043 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 09:53:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:54:18.746751 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=19 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:18.747509 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:18.751385 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4660228a-e40d-4f84-a795-148f8e28f702 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:18.751882 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4660228a-e40d-4f84-a795-148f8e28f702 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:18.757796 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4660228a-e40d-4f84-a795-148f8e28f702 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:18.774558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4660228a-e40d-4f84-a795-148f8e28f702 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:18.774558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4660228a-e40d-4f84-a795-148f8e28f702 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:18.774558 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4660228a-e40d-4f84-a795-148f8e28f702 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:18.783335 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4660228a-e40d-4f84-a795-148f8e28f702 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/ips" status: 200 len: 151 microversion: 2.1 time: 0.038447 May 27 09:54:18.783905 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 508/1025] 10.222.0.48 () {58 vars in 1247 bytes} [Fri May 27 09:54:18 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:20.340142 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=11,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:20.340981 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:54:20.345110 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-cceb0355-8a4b-40f3-a742-7be70690b642 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "df60ad0f-ebf5-400d-9fce-850150394559"}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:20.346343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-cceb0355-8a4b-40f3-a742-7be70690b642 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:20.352900 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cceb0355-8a4b-40f3-a742-7be70690b642 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:20.353345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cceb0355-8a4b-40f3-a742-7be70690b642 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:20.354095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cceb0355-8a4b-40f3-a742-7be70690b642 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:20.354585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-cceb0355-8a4b-40f3-a742-7be70690b642 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:21.374361 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-cceb0355-8a4b-40f3-a742-7be70690b642 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "POST /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.036398 May 27 09:54:21.375017 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 518/1026] 10.222.0.48 () {60 vars in 1322 bytes} [Fri May 27 09:54:20 2022] POST /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/os-volume_attachments => generated 194 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:28.969430 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e39926a3-1957-4beb-be1e-a47d1709e60e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:28.970051 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e39926a3-1957-4beb-be1e-a47d1709e60e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:28.977154 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e39926a3-1957-4beb-be1e-a47d1709e60e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:28.977606 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e39926a3-1957-4beb-be1e-a47d1709e60e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:28.978414 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e39926a3-1957-4beb-be1e-a47d1709e60e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:28.978856 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e39926a3-1957-4beb-be1e-a47d1709e60e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:29.060886 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-e39926a3-1957-4beb-be1e-a47d1709e60e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lazy-loading 'services' on Instance uuid d6c2294d-dd65-4bca-8557-e7652982099b {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:54:29.333640 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e39926a3-1957-4beb-be1e-a47d1709e60e tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/os-volume_attachments/df60ad0f-ebf5-400d-9fce-850150394559" status: 202 len: 0 microversion: 2.1 time: 0.368484 May 27 09:54:29.334373 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 509/1027] 10.222.0.48 () {58 vars in 1415 bytes} [Fri May 27 09:54:28 2022] DELETE /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/os-volume_attachments/df60ad0f-ebf5-400d-9fce-850150394559 => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:54:29.344551 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-69d3c9c6-5937-4b61-9565-f18147108d89 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:29.345751 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-69d3c9c6-5937-4b61-9565-f18147108d89 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:29.352042 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-69d3c9c6-5937-4b61-9565-f18147108d89 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:29.352494 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-69d3c9c6-5937-4b61-9565-f18147108d89 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:29.353320 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-69d3c9c6-5937-4b61-9565-f18147108d89 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:29.353759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-69d3c9c6-5937-4b61-9565-f18147108d89 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:29.383607 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-69d3c9c6-5937-4b61-9565-f18147108d89 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044384 May 27 09:54:29.384169 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 519/1028] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:54:29 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:30.397048 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-aafe2b42-bf53-4883-8663-5c9ca029bb95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:30.398125 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-aafe2b42-bf53-4883-8663-5c9ca029bb95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:30.405320 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aafe2b42-bf53-4883-8663-5c9ca029bb95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:30.405834 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aafe2b42-bf53-4883-8663-5c9ca029bb95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:30.406719 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aafe2b42-bf53-4883-8663-5c9ca029bb95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:30.407216 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aafe2b42-bf53-4883-8663-5c9ca029bb95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:30.441328 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-aafe2b42-bf53-4883-8663-5c9ca029bb95 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049149 May 27 09:54:30.441894 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 510/1029] 10.222.0.48 () {58 vars in 1301 bytes} [Fri May 27 09:54:30 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 27 09:54:30.499809 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ac611a63-40f3-45d7-89e3-35e0a9647de4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:30.504591 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ac611a63-40f3-45d7-89e3-35e0a9647de4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:30.507092 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ac611a63-40f3-45d7-89e3-35e0a9647de4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:30.507549 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ac611a63-40f3-45d7-89e3-35e0a9647de4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:30.508313 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ac611a63-40f3-45d7-89e3-35e0a9647de4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:30.508755 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-ac611a63-40f3-45d7-89e3-35e0a9647de4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:30.533197 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ac611a63-40f3-45d7-89e3-35e0a9647de4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 09:54:30.832535 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ac611a63-40f3-45d7-89e3-35e0a9647de4 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 204 len: 0 microversion: 2.1 time: 0.336930 May 27 09:54:30.833081 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 520/1030] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:54:30 2022] DELETE /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 09:54:30.841268 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2738da34-9af8-4bc7-91ef-217421d4de8c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:30.841882 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2738da34-9af8-4bc7-91ef-217421d4de8c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:30.847895 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2738da34-9af8-4bc7-91ef-217421d4de8c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:30.848336 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2738da34-9af8-4bc7-91ef-217421d4de8c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:30.849087 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2738da34-9af8-4bc7-91ef-217421d4de8c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:30.849514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2738da34-9af8-4bc7-91ef-217421d4de8c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:30.981016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2738da34-9af8-4bc7-91ef-217421d4de8c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:30.989024 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2738da34-9af8-4bc7-91ef-217421d4de8c tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1683 microversion: 2.1 time: 0.151684 May 27 09:54:30.989584 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 511/1031] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:54:30 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:32.007157 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c0407ce4-3a66-4832-a931-ced47aff9df9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:32.007855 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c0407ce4-3a66-4832-a931-ced47aff9df9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:32.014772 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c0407ce4-3a66-4832-a931-ced47aff9df9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:32.015215 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c0407ce4-3a66-4832-a931-ced47aff9df9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:32.015958 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c0407ce4-3a66-4832-a931-ced47aff9df9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:32.016386 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c0407ce4-3a66-4832-a931-ced47aff9df9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:32.145869 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c0407ce4-3a66-4832-a931-ced47aff9df9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:32.153460 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c0407ce4-3a66-4832-a931-ced47aff9df9 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1683 microversion: 2.1 time: 0.150553 May 27 09:54:32.155972 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 521/1032] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:54:32 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:33.172395 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ed660f4c-3842-41a7-b69b-e51d55f8f44a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:33.172999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ed660f4c-3842-41a7-b69b-e51d55f8f44a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:33.179574 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ed660f4c-3842-41a7-b69b-e51d55f8f44a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:33.180022 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ed660f4c-3842-41a7-b69b-e51d55f8f44a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:33.180780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ed660f4c-3842-41a7-b69b-e51d55f8f44a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:33.181210 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ed660f4c-3842-41a7-b69b-e51d55f8f44a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:33.319203 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ed660f4c-3842-41a7-b69b-e51d55f8f44a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:33.327254 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ed660f4c-3842-41a7-b69b-e51d55f8f44a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1683 microversion: 2.1 time: 0.158770 May 27 09:54:33.327780 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 512/1033] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:54:33 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:33.653638 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-3952758d-e110-45f0-95ca-ba2616a5ad98 req-76328d99-ad02-40c2-81bd-cc36cc158619 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6c2294d-dd65-4bca-8557-e7652982099b", "name": "network-vif-deleted", "tag": "78424066-9f6d-4f5e-b4ef-68913a80624f"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:54:33.663226 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-3952758d-e110-45f0-95ca-ba2616a5ad98 req-76328d99-ad02-40c2-81bd-cc36cc158619 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:33.663668 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-3952758d-e110-45f0-95ca-ba2616a5ad98 req-76328d99-ad02-40c2-81bd-cc36cc158619 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:33.675348 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-3952758d-e110-45f0-95ca-ba2616a5ad98 req-76328d99-ad02-40c2-81bd-cc36cc158619 service nova] Creating event network-vif-deleted:78424066-9f6d-4f5e-b4ef-68913a80624f for instance d6c2294d-dd65-4bca-8557-e7652982099b on hv-cinder-82549 May 27 09:54:33.680216 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-3952758d-e110-45f0-95ca-ba2616a5ad98 req-76328d99-ad02-40c2-81bd-cc36cc158619 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 May 27 09:54:33.680902 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 522/1034] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:54:34.345230 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:34.346899 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:34.353371 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:34.353918 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:34.354787 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:34.355362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:34.396798 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:34.397245 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:34.397699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lazy-loading 'fault' on Instance uuid d6c2294d-dd65-4bca-8557-e7652982099b {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:54:34.440497 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6772c708b48b404bb9f8794142ec6060', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b2ae84b95ae44d18119450b94735f03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:54:34.448900 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ac4dfa3a-64d8-462a-bca1-bc386c61d2dd tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 200 len: 1332 microversion: 2.1 time: 0.107680 May 27 09:54:34.449608 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 513/1035] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:54:34 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:54:35.466970 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-aa6a64bb-cbc8-404b-acdc-99b377659d22 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:35.467738 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-aa6a64bb-cbc8-404b-acdc-99b377659d22 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:35.473953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aa6a64bb-cbc8-404b-acdc-99b377659d22 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:35.474440 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aa6a64bb-cbc8-404b-acdc-99b377659d22 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:35.475198 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aa6a64bb-cbc8-404b-acdc-99b377659d22 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:35.475641 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-aa6a64bb-cbc8-404b-acdc-99b377659d22 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:35.488769 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-aa6a64bb-cbc8-404b-acdc-99b377659d22 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-aa6a64bb-cbc8-404b-acdc-99b377659d22 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b HTTP/1.1 May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:54:35.490402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:35.492156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': 'd6c2294d-dd65-4bca-8557-e7652982099b'} May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:35.493326 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:35.494929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:35.496582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-aa6a64bb-cbc8-404b-acdc-99b377659d22 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:35.496582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-aa6a64bb-cbc8-404b-acdc-99b377659d22 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 404 len: 111 microversion: 2.1 time: 0.029636 May 27 09:54:35.496582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 523/1036] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:54:35 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:54:35.501346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-11c7e6fe-d948-45de-89df-794e166cd38b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '.version_select at 0x7fbe375cdf70>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:35.637987 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-11c7e6fe-d948-45de-89df-794e166cd38b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245814886" status: 202 len: 0 microversion: 2.1 time: 0.141036 May 27 09:54:35.638621 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 514/1037] 10.222.0.48 () {58 vars in 1220 bytes} [Fri May 27 09:54:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1245814886 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:54:37.628988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-312d2ac9-9bcc-4c26-a0e3-7dbf7e7e857a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:37.629471 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-312d2ac9-9bcc-4c26-a0e3-7dbf7e7e857a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:37.635882 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-312d2ac9-9bcc-4c26-a0e3-7dbf7e7e857a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:37.636327 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-312d2ac9-9bcc-4c26-a0e3-7dbf7e7e857a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:37.637076 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-312d2ac9-9bcc-4c26-a0e3-7dbf7e7e857a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:37.637507 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-312d2ac9-9bcc-4c26-a0e3-7dbf7e7e857a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:37.650768 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-312d2ac9-9bcc-4c26-a0e3-7dbf7e7e857a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-312d2ac9-9bcc-4c26-a0e3-7dbf7e7e857a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b HTTP/1.1 May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:54:37.652318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:37.653919 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': 'd6c2294d-dd65-4bca-8557-e7652982099b'} May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:37.655431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:37.657130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:37.658681 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-312d2ac9-9bcc-4c26-a0e3-7dbf7e7e857a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:37.658681 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-312d2ac9-9bcc-4c26-a0e3-7dbf7e7e857a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 404 len: 111 microversion: 2.1 time: 0.028552 May 27 09:54:37.658681 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 524/1038] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:54:37 2022] DELETE /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 27 09:54:37.664434 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e9a51ae3-207f-4a81-82e0-9f100e96f394 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:37.665051 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e9a51ae3-207f-4a81-82e0-9f100e96f394 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: d6c2294d-dd65-4bca-8557-e7652982099b] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:37.672468 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e9a51ae3-207f-4a81-82e0-9f100e96f394 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:37.672921 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e9a51ae3-207f-4a81-82e0-9f100e96f394 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:37.673680 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e9a51ae3-207f-4a81-82e0-9f100e96f394 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:37.674338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e9a51ae3-207f-4a81-82e0-9f100e96f394 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:37.687628 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-e9a51ae3-207f-4a81-82e0-9f100e96f394 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e9a51ae3-207f-4a81-82e0-9f100e96f394 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b HTTP/1.1 May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:54:37.689059 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:37.690699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': 'd6c2294d-dd65-4bca-8557-e7652982099b'} May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:37.691560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. May 27 09:54:37.693038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:37.694383 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e9a51ae3-207f-4a81-82e0-9f100e96f394 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance d6c2294d-dd65-4bca-8557-e7652982099b could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:37.694383 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e9a51ae3-207f-4a81-82e0-9f100e96f394 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b" status: 404 len: 111 microversion: 2.1 time: 0.030422 May 27 09:54:37.694383 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 515/1039] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:54:37 2022] GET /compute/v2.1/servers/d6c2294d-dd65-4bca-8557-e7652982099b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:54:39.122039 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2a78007c-f408-4194-a66f-f818cb1c0088 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:39.122624 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2a78007c-f408-4194-a66f-f818cb1c0088 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:39.129489 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2a78007c-f408-4194-a66f-f818cb1c0088 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:39.129931 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2a78007c-f408-4194-a66f-f818cb1c0088 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:39.130716 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2a78007c-f408-4194-a66f-f818cb1c0088 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:39.131150 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2a78007c-f408-4194-a66f-f818cb1c0088 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:39.145002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-2a78007c-f408-4194-a66f-f818cb1c0088 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2a78007c-f408-4194-a66f-f818cb1c0088 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 HTTP/1.1 May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:54:39.146548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:54:39.147975 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': 'f9c66bef-7418-40f9-a919-6bb085d2cd51'} May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:39.148744 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:54:39.149969 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:39.152038 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2a78007c-f408-4194-a66f-f818cb1c0088 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:39.152038 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2a78007c-f408-4194-a66f-f818cb1c0088 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 404 len: 111 microversion: 2.1 time: 0.029807 May 27 09:54:39.152038 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 525/1040] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:54:39 2022] DELETE /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:54:39.156843 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ce19dadc-cc29-4090-bbd2-363f81ae4ff7 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:39.157454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ce19dadc-cc29-4090-bbd2-363f81ae4ff7 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: f9c66bef-7418-40f9-a919-6bb085d2cd51] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:39.164143 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ce19dadc-cc29-4090-bbd2-363f81ae4ff7 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:39.164583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ce19dadc-cc29-4090-bbd2-363f81ae4ff7 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:39.165337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ce19dadc-cc29-4090-bbd2-363f81ae4ff7 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:39.165768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ce19dadc-cc29-4090-bbd2-363f81ae4ff7 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:39.179506 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-ce19dadc-cc29-4090-bbd2-363f81ae4ff7 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ce19dadc-cc29-4090-bbd2-363f81ae4ff7 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 HTTP/1.1 May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:54:39.181337 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:54:39.183084 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': 'f9c66bef-7418-40f9-a919-6bb085d2cd51'} May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:39.184219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. May 27 09:54:39.185690 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:39.187602 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ce19dadc-cc29-4090-bbd2-363f81ae4ff7 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance f9c66bef-7418-40f9-a919-6bb085d2cd51 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:39.187602 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ce19dadc-cc29-4090-bbd2-363f81ae4ff7 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51" status: 404 len: 111 microversion: 2.1 time: 0.029957 May 27 09:54:39.187602 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 516/1041] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:54:39 2022] GET /compute/v2.1/servers/f9c66bef-7418-40f9-a919-6bb085d2cd51 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:54:39.191856 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-01a8315a-260d-4909-895c-34937ef1581a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:39.192356 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-01a8315a-260d-4909-895c-34937ef1581a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:39.198478 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-01a8315a-260d-4909-895c-34937ef1581a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:39.198927 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-01a8315a-260d-4909-895c-34937ef1581a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:39.199692 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-01a8315a-260d-4909-895c-34937ef1581a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:39.200127 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-01a8315a-260d-4909-895c-34937ef1581a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:39.216585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-01a8315a-260d-4909-895c-34937ef1581a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-01a8315a-260d-4909-895c-34937ef1581a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 HTTP/1.1 May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:54:39.227047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:54:39.229120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '61a4f200-7733-45c0-8799-a97b6779ffa4'} May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:39.230078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:54:39.231582 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:39.233612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-01a8315a-260d-4909-895c-34937ef1581a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:39.233612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-01a8315a-260d-4909-895c-34937ef1581a tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 404 len: 111 microversion: 2.1 time: 0.032579 May 27 09:54:39.233612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 526/1042] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:54:39 2022] DELETE /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:54:39.234332 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3ab97b27-315f-46aa-a71f-02a6754bccbb tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:39.234945 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3ab97b27-315f-46aa-a71f-02a6754bccbb tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 61a4f200-7733-45c0-8799-a97b6779ffa4] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:39.241048 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ab97b27-315f-46aa-a71f-02a6754bccbb tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:39.241521 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ab97b27-315f-46aa-a71f-02a6754bccbb tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:39.242316 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ab97b27-315f-46aa-a71f-02a6754bccbb tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:39.242775 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ab97b27-315f-46aa-a71f-02a6754bccbb tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:39.256126 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-3ab97b27-315f-46aa-a71f-02a6754bccbb tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3ab97b27-315f-46aa-a71f-02a6754bccbb tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 HTTP/1.1 May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:54:39.257644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:54:39.259323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '61a4f200-7733-45c0-8799-a97b6779ffa4'} May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:39.260207 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. May 27 09:54:39.261431 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:39.262611 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3ab97b27-315f-46aa-a71f-02a6754bccbb tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance 61a4f200-7733-45c0-8799-a97b6779ffa4 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:39.262611 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3ab97b27-315f-46aa-a71f-02a6754bccbb tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4" status: 404 len: 111 microversion: 2.1 time: 0.029182 May 27 09:54:39.262611 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 517/1043] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:54:39 2022] GET /compute/v2.1/servers/61a4f200-7733-45c0-8799-a97b6779ffa4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:54:40.541952 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-dad0bfb8-8df7-4f70-97c2-bb8df7791a72 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:40.542756 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-dad0bfb8-8df7-4f70-97c2-bb8df7791a72 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:40.550280 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dad0bfb8-8df7-4f70-97c2-bb8df7791a72 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:40.550732 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dad0bfb8-8df7-4f70-97c2-bb8df7791a72 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:40.551500 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dad0bfb8-8df7-4f70-97c2-bb8df7791a72 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:40.551938 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dad0bfb8-8df7-4f70-97c2-bb8df7791a72 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:40.565304 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-dad0bfb8-8df7-4f70-97c2-bb8df7791a72 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-dad0bfb8-8df7-4f70-97c2-bb8df7791a72 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf HTTP/1.1 May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 09:54:40.566877 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:54:40.568343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '1d52913b-ebb2-470d-aafe-129bead9bedf'} May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:40.569837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:54:40.571871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 09:54:40.573107 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-dad0bfb8-8df7-4f70-97c2-bb8df7791a72 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:40.573107 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-dad0bfb8-8df7-4f70-97c2-bb8df7791a72 tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 404 len: 111 microversion: 2.1 time: 0.030229 May 27 09:54:40.573107 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 527/1044] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 09:54:40 2022] DELETE /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:54:40.576912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-424ef592-2c06-48b0-bbf9-a6ec0444729b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:54:40.577526 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-424ef592-2c06-48b0-bbf9-a6ec0444729b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] [instance: 1d52913b-ebb2-470d-aafe-129bead9bedf] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:54:40.583957 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-424ef592-2c06-48b0-bbf9-a6ec0444729b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:40.584400 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-424ef592-2c06-48b0-bbf9-a6ec0444729b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:40.585150 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-424ef592-2c06-48b0-bbf9-a6ec0444729b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:54:40.585582 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-424ef592-2c06-48b0-bbf9-a6ec0444729b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:54:40.600169 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-424ef592-2c06-48b0-bbf9-a6ec0444729b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] HTTP exception thrown: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-424ef592-2c06-48b0-bbf9-a6ec0444729b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Request method failure captured: May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf HTTP/1.1 May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikJ3k6DxuB90hdS982OZU5bz7dgNNFI3Ez7201TDNzlfv9bPaY09HgOy2jC21IbYjxtm5v6dMz5EWN09G74qm5L5ij26ywqMtCiCaPL6Ohhs7KQmt9gxP4nT-v28dVxbB6Y1t6dQuzg7T5aGMwuagD8_eiBQpIJscNdHfocM5Jm-R0nM May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 09:54:40.601692 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/1b2ae84b95ae44d18119450b94735f03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_1b2ae84b95ae44d18119450b94735f03", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: 1b2ae84b95ae44d18119450b94735f03 May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1820901690 May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: 6772c708b48b404bb9f8794142ec6060 May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-AttachVolumeNegativeTest-1820901690-project May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:54:40.603251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '1d52913b-ebb2-470d-aafe-129bead9bedf'} May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 09:54:40.604197 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. May 27 09:54:40.605725 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 09:54:40.607201 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-424ef592-2c06-48b0-bbf9-a6ec0444729b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] Returning 404 to user: Instance 1d52913b-ebb2-470d-aafe-129bead9bedf could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 09:54:40.607201 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-424ef592-2c06-48b0-bbf9-a6ec0444729b tempest-AttachVolumeNegativeTest-1820901690 tempest-AttachVolumeNegativeTest-1820901690-project] 10.222.0.48 "GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf" status: 404 len: 111 microversion: 2.1 time: 0.030110 May 27 09:54:40.607201 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 518/1045] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:54:40 2022] GET /compute/v2.1/servers/1d52913b-ebb2-470d-aafe-129bead9bedf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 09:55:54.664559 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:55:54.665313 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:55:54.859362 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4b1d7009-a404-46e2-9c6c-3afb09c668bd tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Action: 'create', calling method: .version_select at 0x7fbe32457550>, body: {"keypair": {"name": "tempest-TestShelveInstance-1240464613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBH5EzozR7CgC/FkGm+rMxZm0zQlyHJRTbWPQDtWwK37lQ4ZKc+GvtDEPkxtC9qwbcT+RXLwGg8CENBokDxnEvHsYs8OLPPfJYa8PjUzVjsSXoIVTTm607OXEDo6c1C8sg=="}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:55:54.880278 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-4b1d7009-a404-46e2-9c6c-3afb09c668bd tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Getting quotas for project d927de989e8244d19dc9d2f54da6738c. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:55:54.886788 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-4b1d7009-a404-46e2-9c6c-3afb09c668bd tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Getting quotas for user 43510113da604d528b4472ee77bc1061 and project d927de989e8244d19dc9d2f54da6738c. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:55:55.010847 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4b1d7009-a404-46e2-9c6c-3afb09c668bd tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.347914 May 27 09:55:55.015422 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 528/1046] 10.222.0.48 () {60 vars in 1158 bytes} [Fri May 27 09:55:54 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:19.546429 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:19.547211 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:19.551231 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1882730240", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1240464613", "security_groups": [{"name": "tempest-secgroup-smoke-608677092"}], "networks": [{"uuid": "109be6f9-373c-4b1c-b818-f4a73a80feaa"}], "block_device_mapping_v2": [{"uuid": "bee66599-c203-4e32-ac1b-266f32ca75ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:56:19.661782 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] validate_networks() for [('109be6f9-373c-4b1c-b818-f4a73a80feaa', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 09:56:20.113777 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 09:56:20.114212 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 09:56:20.114698 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 09:56:20.115110 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 09:56:20.115525 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 09:56:20.125126 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:20.125605 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:20.126508 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:20.126877 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:20.143755 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Getting quotas for project d927de989e8244d19dc9d2f54da6738c. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 09:56:20.147693 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Getting quotas for user 43510113da604d528b4472ee77bc1061 and project d927de989e8244d19dc9d2f54da6738c. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 09:56:20.205306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 09:56:20.207587 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bee66599-c203-4e32-ac1b-266f32ca75ef',volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 09:56:20.696205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-eaac5403-9b78-41eb-bf64-b05dfdce81c5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.151508 May 27 09:56:20.696882 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 519/1047] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 09:56:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1153 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 09:56:20.704574 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=4 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:20.705635 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:20.709900 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8b2bf2ad-a564-43e2-b172-df8f9b1eba77 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:20.710670 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8b2bf2ad-a564-43e2-b172-df8f9b1eba77 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:20.766240 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8b2bf2ad-a564-43e2-b172-df8f9b1eba77 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:20.772895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8b2bf2ad-a564-43e2-b172-df8f9b1eba77 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1089 microversion: 2.1 time: 0.069705 May 27 09:56:20.773455 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 529/1048] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:20 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:21.791418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ba1ffc4f-82e1-438f-be57-8817d42a01e9 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:21.792026 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ba1ffc4f-82e1-438f-be57-8817d42a01e9 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:21.845596 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ba1ffc4f-82e1-438f-be57-8817d42a01e9 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:21.852618 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ba1ffc4f-82e1-438f-be57-8817d42a01e9 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1089 microversion: 2.1 time: 0.065828 May 27 09:56:21.853182 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 520/1049] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:21 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:22.871217 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-ab32704d-01cf-4c7c-a9a2-5da2c927dbb3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:22.871737 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-ab32704d-01cf-4c7c-a9a2-5da2c927dbb3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:22.925396 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-ab32704d-01cf-4c7c-a9a2-5da2c927dbb3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:22.932138 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-ab32704d-01cf-4c7c-a9a2-5da2c927dbb3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1089 microversion: 2.1 time: 0.065553 May 27 09:56:22.932974 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 530/1050] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:22 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1089 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:23.949401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b0675770-2c51-4137-9ffe-5faf326ab7de tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:23.950033 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b0675770-2c51-4137-9ffe-5faf326ab7de tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:24.006021 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b0675770-2c51-4137-9ffe-5faf326ab7de tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:24.013516 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b0675770-2c51-4137-9ffe-5faf326ab7de tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1089 microversion: 2.1 time: 0.068581 May 27 09:56:24.014080 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 521/1051] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:23 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:25.031388 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-85bd242a-4744-45ba-9085-46b7912a60ac tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:25.032075 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-85bd242a-4744-45ba-9085-46b7912a60ac tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:25.038804 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-85bd242a-4744-45ba-9085-46b7912a60ac tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:25.039281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-85bd242a-4744-45ba-9085-46b7912a60ac tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:25.040081 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-85bd242a-4744-45ba-9085-46b7912a60ac tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:25.040517 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-85bd242a-4744-45ba-9085-46b7912a60ac tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:25.102889 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-85bd242a-4744-45ba-9085-46b7912a60ac tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:25.110374 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-85bd242a-4744-45ba-9085-46b7912a60ac tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1139 microversion: 2.1 time: 0.083715 May 27 09:56:25.110937 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 531/1052] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:25 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1139 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:26.127751 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bbc1b371-c796-44f7-ab90-f60ef2f220e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:26.128299 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bbc1b371-c796-44f7-ab90-f60ef2f220e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:26.134458 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bbc1b371-c796-44f7-ab90-f60ef2f220e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:26.134907 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bbc1b371-c796-44f7-ab90-f60ef2f220e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:26.135670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bbc1b371-c796-44f7-ab90-f60ef2f220e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:26.136104 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bbc1b371-c796-44f7-ab90-f60ef2f220e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:26.197996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bbc1b371-c796-44f7-ab90-f60ef2f220e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:26.204143 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bbc1b371-c796-44f7-ab90-f60ef2f220e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1139 microversion: 2.1 time: 0.080622 May 27 09:56:26.204699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 522/1053] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:26 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1139 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:27.220965 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1b1f4964-c60c-46c8-8680-57ff0093c411 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:27.221568 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1b1f4964-c60c-46c8-8680-57ff0093c411 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:27.228565 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b1f4964-c60c-46c8-8680-57ff0093c411 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:27.228675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b1f4964-c60c-46c8-8680-57ff0093c411 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:27.229513 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b1f4964-c60c-46c8-8680-57ff0093c411 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:27.229864 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1b1f4964-c60c-46c8-8680-57ff0093c411 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:27.298324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1b1f4964-c60c-46c8-8680-57ff0093c411 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:27.306878 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1b1f4964-c60c-46c8-8680-57ff0093c411 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1205 microversion: 2.1 time: 0.089855 May 27 09:56:27.307452 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 532/1054] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:27 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1205 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:56:28.325205 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1a2fc603-dbe7-4d53-ab72-78b175a8fb68 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:28.326034 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1a2fc603-dbe7-4d53-ab72-78b175a8fb68 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:28.333027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a2fc603-dbe7-4d53-ab72-78b175a8fb68 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:28.333484 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a2fc603-dbe7-4d53-ab72-78b175a8fb68 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:28.334522 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a2fc603-dbe7-4d53-ab72-78b175a8fb68 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:28.334958 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1a2fc603-dbe7-4d53-ab72-78b175a8fb68 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:28.506754 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1a2fc603-dbe7-4d53-ab72-78b175a8fb68 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:28.532311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1a2fc603-dbe7-4d53-ab72-78b175a8fb68 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1272 microversion: 2.1 time: 0.210335 May 27 09:56:28.533839 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 523/1055] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:28 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:28.792520 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-0ad87f0a-d53d-44ca-997c-a7b0a4fd35c5 req-c721f87d-8fab-4761-ab4b-8ce61d9e8e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbacef2f-7879-416e-9fc3-79d334cf4ed9", "tag": "e2fa5975-c182-41a2-baed-897e42da75a1"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:56:28.802895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-0ad87f0a-d53d-44ca-997c-a7b0a4fd35c5 req-c721f87d-8fab-4761-ab4b-8ce61d9e8e01 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:28.803338 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-0ad87f0a-d53d-44ca-997c-a7b0a4fd35c5 req-c721f87d-8fab-4761-ab4b-8ce61d9e8e01 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:28.816590 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-0ad87f0a-d53d-44ca-997c-a7b0a4fd35c5 req-c721f87d-8fab-4761-ab4b-8ce61d9e8e01 service nova] Creating event network-changed:e2fa5975-c182-41a2-baed-897e42da75a1 for instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 on hv-cinder-82549 May 27 09:56:28.821730 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-0ad87f0a-d53d-44ca-997c-a7b0a4fd35c5 req-c721f87d-8fab-4761-ab4b-8ce61d9e8e01 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035432 May 27 09:56:28.822367 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 533/1056] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:29.550993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-97fc8600-7089-497e-ab31-44cad016ee61 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:29.551521 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-97fc8600-7089-497e-ab31-44cad016ee61 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:29.558110 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-97fc8600-7089-497e-ab31-44cad016ee61 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:29.558597 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-97fc8600-7089-497e-ab31-44cad016ee61 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:29.559373 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-97fc8600-7089-497e-ab31-44cad016ee61 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:29.560399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-97fc8600-7089-497e-ab31-44cad016ee61 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:29.693531 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-97fc8600-7089-497e-ab31-44cad016ee61 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:29.701759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-97fc8600-7089-497e-ab31-44cad016ee61 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.154819 May 27 09:56:29.702345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 524/1057] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:29 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:30.720488 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3a0ef041-ebbe-44a2-8459-57628d6b112d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:30.721200 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3a0ef041-ebbe-44a2-8459-57628d6b112d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:30.727526 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3a0ef041-ebbe-44a2-8459-57628d6b112d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:30.727978 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3a0ef041-ebbe-44a2-8459-57628d6b112d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:30.728753 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3a0ef041-ebbe-44a2-8459-57628d6b112d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:30.729732 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3a0ef041-ebbe-44a2-8459-57628d6b112d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:30.866669 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3a0ef041-ebbe-44a2-8459-57628d6b112d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:30.875257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3a0ef041-ebbe-44a2-8459-57628d6b112d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.160040 May 27 09:56:30.875838 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 534/1058] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:30 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:31.892076 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-715f8fc5-e7e5-4134-9f9d-67c8288ad86e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:31.892681 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-715f8fc5-e7e5-4134-9f9d-67c8288ad86e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:31.894529 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:31.899806 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-715f8fc5-e7e5-4134-9f9d-67c8288ad86e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:31.900247 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-715f8fc5-e7e5-4134-9f9d-67c8288ad86e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:31.901008 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-715f8fc5-e7e5-4134-9f9d-67c8288ad86e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:31.901435 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-715f8fc5-e7e5-4134-9f9d-67c8288ad86e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:32.029858 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-715f8fc5-e7e5-4134-9f9d-67c8288ad86e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:32.038774 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-715f8fc5-e7e5-4134-9f9d-67c8288ad86e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.150201 May 27 09:56:32.039829 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 525/1059] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:31 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:56:33.062238 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-176c6cdb-dfcc-4ac0-ac53-72cf9b8500b5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:33.062882 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-176c6cdb-dfcc-4ac0-ac53-72cf9b8500b5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:33.065262 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=4 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:33.070147 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-176c6cdb-dfcc-4ac0-ac53-72cf9b8500b5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:33.070621 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-176c6cdb-dfcc-4ac0-ac53-72cf9b8500b5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:33.071375 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-176c6cdb-dfcc-4ac0-ac53-72cf9b8500b5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:33.071891 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-176c6cdb-dfcc-4ac0-ac53-72cf9b8500b5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:33.201235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-176c6cdb-dfcc-4ac0-ac53-72cf9b8500b5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:33.208817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-176c6cdb-dfcc-4ac0-ac53-72cf9b8500b5 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.151189 May 27 09:56:33.209382 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 535/1060] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:33 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:34.226159 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-261a5ce6-0af1-4f03-b991-3332dbce448c tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:34.226788 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-261a5ce6-0af1-4f03-b991-3332dbce448c tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:34.229055 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=10 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:56:34.233952 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-261a5ce6-0af1-4f03-b991-3332dbce448c tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:34.234478 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-261a5ce6-0af1-4f03-b991-3332dbce448c tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:34.235264 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-261a5ce6-0af1-4f03-b991-3332dbce448c tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:34.235808 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-261a5ce6-0af1-4f03-b991-3332dbce448c tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:34.368746 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-261a5ce6-0af1-4f03-b991-3332dbce448c tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:34.376751 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-261a5ce6-0af1-4f03-b991-3332dbce448c tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.154601 May 27 09:56:34.377311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 526/1061] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:34 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:35.393689 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-331d44b5-8ecb-445b-9822-b63764dcc87a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:35.394317 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-331d44b5-8ecb-445b-9822-b63764dcc87a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:35.400874 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-331d44b5-8ecb-445b-9822-b63764dcc87a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:35.401321 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-331d44b5-8ecb-445b-9822-b63764dcc87a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:35.402070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-331d44b5-8ecb-445b-9822-b63764dcc87a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:35.402528 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-331d44b5-8ecb-445b-9822-b63764dcc87a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:35.536464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-331d44b5-8ecb-445b-9822-b63764dcc87a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:35.544241 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-331d44b5-8ecb-445b-9822-b63764dcc87a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.154306 May 27 09:56:35.545776 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 536/1062] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:35 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:36.562776 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3de9c002-857d-4de6-886d-0630acce6872 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:36.563418 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3de9c002-857d-4de6-886d-0630acce6872 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:36.570393 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3de9c002-857d-4de6-886d-0630acce6872 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:36.570847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3de9c002-857d-4de6-886d-0630acce6872 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:36.571576 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3de9c002-857d-4de6-886d-0630acce6872 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:36.572025 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3de9c002-857d-4de6-886d-0630acce6872 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:36.700413 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3de9c002-857d-4de6-886d-0630acce6872 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:36.708516 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3de9c002-857d-4de6-886d-0630acce6872 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.150478 May 27 09:56:36.709073 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 527/1063] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:36 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:37.725029 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5e879f34-3a10-4b7e-bdca-404d7d98688e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:37.725864 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5e879f34-3a10-4b7e-bdca-404d7d98688e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:37.732548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5e879f34-3a10-4b7e-bdca-404d7d98688e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:37.733000 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5e879f34-3a10-4b7e-bdca-404d7d98688e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:37.733765 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5e879f34-3a10-4b7e-bdca-404d7d98688e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:37.734226 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5e879f34-3a10-4b7e-bdca-404d7d98688e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:37.864980 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5e879f34-3a10-4b7e-bdca-404d7d98688e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:37.872655 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5e879f34-3a10-4b7e-bdca-404d7d98688e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.151522 May 27 09:56:37.873722 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 537/1064] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:37 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:38.889291 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f63e1836-7453-4e2f-8266-dd013d6c543a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:38.889898 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f63e1836-7453-4e2f-8266-dd013d6c543a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:38.896303 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f63e1836-7453-4e2f-8266-dd013d6c543a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:38.896750 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f63e1836-7453-4e2f-8266-dd013d6c543a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:38.897547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f63e1836-7453-4e2f-8266-dd013d6c543a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:38.897984 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f63e1836-7453-4e2f-8266-dd013d6c543a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:39.032536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f63e1836-7453-4e2f-8266-dd013d6c543a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:39.039961 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f63e1836-7453-4e2f-8266-dd013d6c543a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.154567 May 27 09:56:39.040526 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 528/1065] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:38 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:39.572545 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-d63e64b4-1f57-4f24-bffb-07ac60ba3ab1 req-ec66bcad-5437-4f60-846a-4dd09d0c74f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbacef2f-7879-416e-9fc3-79d334cf4ed9", "name": "network-vif-plugged", "status": "completed", "tag": "e2fa5975-c182-41a2-baed-897e42da75a1"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:56:39.581235 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-d63e64b4-1f57-4f24-bffb-07ac60ba3ab1 req-ec66bcad-5437-4f60-846a-4dd09d0c74f5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:39.581677 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-d63e64b4-1f57-4f24-bffb-07ac60ba3ab1 req-ec66bcad-5437-4f60-846a-4dd09d0c74f5 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:39.592375 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-d63e64b4-1f57-4f24-bffb-07ac60ba3ab1 req-ec66bcad-5437-4f60-846a-4dd09d0c74f5 service nova] Creating event network-vif-plugged:e2fa5975-c182-41a2-baed-897e42da75a1 for instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 on hv-cinder-82549 May 27 09:56:39.597543 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-d63e64b4-1f57-4f24-bffb-07ac60ba3ab1 req-ec66bcad-5437-4f60-846a-4dd09d0c74f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084738 May 27 09:56:39.598423 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 538/1066] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:56:40.057564 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2bdbadf8-546c-4a38-8d29-cd26d753ad81 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:40.058182 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2bdbadf8-546c-4a38-8d29-cd26d753ad81 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:40.065288 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bdbadf8-546c-4a38-8d29-cd26d753ad81 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:40.065738 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bdbadf8-546c-4a38-8d29-cd26d753ad81 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:40.066543 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bdbadf8-546c-4a38-8d29-cd26d753ad81 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:40.066981 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bdbadf8-546c-4a38-8d29-cd26d753ad81 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:40.200435 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2bdbadf8-546c-4a38-8d29-cd26d753ad81 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:40.208006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2bdbadf8-546c-4a38-8d29-cd26d753ad81 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.154285 May 27 09:56:40.208580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 529/1067] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:40 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:41.226564 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e8e21345-7780-4878-bdf0-3f1a8acdc5dc tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:41.227289 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e8e21345-7780-4878-bdf0-3f1a8acdc5dc tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:41.233519 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e8e21345-7780-4878-bdf0-3f1a8acdc5dc tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:41.233956 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e8e21345-7780-4878-bdf0-3f1a8acdc5dc tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:41.234736 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e8e21345-7780-4878-bdf0-3f1a8acdc5dc tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:41.235168 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e8e21345-7780-4878-bdf0-3f1a8acdc5dc tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:41.369500 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e8e21345-7780-4878-bdf0-3f1a8acdc5dc tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:41.377004 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e8e21345-7780-4878-bdf0-3f1a8acdc5dc tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1260 microversion: 2.1 time: 0.155264 May 27 09:56:41.377576 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 539/1068] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:41 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:42.393654 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3905ac68-6135-49de-933a-b1fdac189946 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:42.394278 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3905ac68-6135-49de-933a-b1fdac189946 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:42.400779 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3905ac68-6135-49de-933a-b1fdac189946 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:42.401222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3905ac68-6135-49de-933a-b1fdac189946 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:42.401992 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3905ac68-6135-49de-933a-b1fdac189946 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:42.402454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3905ac68-6135-49de-933a-b1fdac189946 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:42.582079 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3905ac68-6135-49de-933a-b1fdac189946 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:42.589718 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3905ac68-6135-49de-933a-b1fdac189946 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1444 microversion: 2.1 time: 0.199684 May 27 09:56:42.590382 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 530/1069] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:42 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1444 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:42.606412 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e78d5839-05ce-4b98-aa1c-660d654d703a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:56:42.607026 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e78d5839-05ce-4b98-aa1c-660d654d703a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:56:42.613997 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e78d5839-05ce-4b98-aa1c-660d654d703a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:42.614477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e78d5839-05ce-4b98-aa1c-660d654d703a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:42.615247 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e78d5839-05ce-4b98-aa1c-660d654d703a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:42.615682 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e78d5839-05ce-4b98-aa1c-660d654d703a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:42.742656 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e78d5839-05ce-4b98-aa1c-660d654d703a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:56:42.750220 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e78d5839-05ce-4b98-aa1c-660d654d703a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1444 microversion: 2.1 time: 0.147681 May 27 09:56:42.750792 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 540/1070] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:56:42 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:56:43.645544 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:56:43.646261 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 09:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:56:44.958266 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-14b3f1f5-2d1d-4c45-bb57-0c5301eaa4da req-00df9044-efa8-45ff-9b17-6d096c0d2ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbacef2f-7879-416e-9fc3-79d334cf4ed9", "tag": "e2fa5975-c182-41a2-baed-897e42da75a1"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:56:44.967016 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-14b3f1f5-2d1d-4c45-bb57-0c5301eaa4da req-00df9044-efa8-45ff-9b17-6d096c0d2ab7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:56:44.967463 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-14b3f1f5-2d1d-4c45-bb57-0c5301eaa4da req-00df9044-efa8-45ff-9b17-6d096c0d2ab7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:56:44.978812 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-14b3f1f5-2d1d-4c45-bb57-0c5301eaa4da req-00df9044-efa8-45ff-9b17-6d096c0d2ab7 service nova] Creating event network-changed:e2fa5975-c182-41a2-baed-897e42da75a1 for instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 on hv-cinder-82549 May 27 09:56:44.984049 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-14b3f1f5-2d1d-4c45-bb57-0c5301eaa4da req-00df9044-efa8-45ff-9b17-6d096c0d2ab7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029459 May 27 09:56:44.984671 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 531/1071] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:58:15.082953 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:58:15.083560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 09:58:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 09:58:58.813290 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=28 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:58:58.814070 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=52 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:58:58.818060 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c753c236-ab7e-40af-9bb2-8c135f10b2e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:58:58.818620 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c753c236-ab7e-40af-9bb2-8c135f10b2e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:58:58.825828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c753c236-ab7e-40af-9bb2-8c135f10b2e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:58:58.825828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c753c236-ab7e-40af-9bb2-8c135f10b2e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:58:58.826396 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c753c236-ab7e-40af-9bb2-8c135f10b2e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:58:58.826838 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c753c236-ab7e-40af-9bb2-8c135f10b2e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:58:58.850472 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-c753c236-ab7e-40af-9bb2-8c135f10b2e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lazy-loading 'flavor' on Instance uuid cbacef2f-7879-416e-9fc3-79d334cf4ed9 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 09:58:59.226749 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c753c236-ab7e-40af-9bb2-8c135f10b2e4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "POST /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9/action" status: 202 len: 0 microversion: 2.1 time: 0.414842 May 27 09:58:59.227322 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 541/1072] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:58:58 2022] POST /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:58:59.233721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3e5c283-68fe-44cc-b801-9d393f524392] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 09:58:59.234343 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:58:59.235087 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=58 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:58:59.239402 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f21c5ee4-e21b-48f8-9c0f-ced0648b90f2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:58:59.240112 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f21c5ee4-e21b-48f8-9c0f-ced0648b90f2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:58:59.246826 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f21c5ee4-e21b-48f8-9c0f-ced0648b90f2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:58:59.247323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f21c5ee4-e21b-48f8-9c0f-ced0648b90f2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:58:59.248119 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f21c5ee4-e21b-48f8-9c0f-ced0648b90f2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:58:59.248557 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f21c5ee4-e21b-48f8-9c0f-ced0648b90f2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:58:59.385103 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f21c5ee4-e21b-48f8-9c0f-ced0648b90f2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:58:59.392795 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f21c5ee4-e21b-48f8-9c0f-ced0648b90f2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.160833 May 27 09:58:59.393358 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 532/1073] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:58:59 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:00.411725 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-70435759-aaff-4209-afab-6dffd0264329 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:00.412425 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-70435759-aaff-4209-afab-6dffd0264329 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:00.418903 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-70435759-aaff-4209-afab-6dffd0264329 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:00.419343 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-70435759-aaff-4209-afab-6dffd0264329 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:00.420093 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-70435759-aaff-4209-afab-6dffd0264329 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:00.420522 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-70435759-aaff-4209-afab-6dffd0264329 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:00.664534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-70435759-aaff-4209-afab-6dffd0264329 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:00.672400 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-70435759-aaff-4209-afab-6dffd0264329 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.265721 May 27 09:59:00.672946 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 542/1074] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:00 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:01.690501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-dec49f7c-31e1-4f0f-904a-ed728534c8a2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:01.691099 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-dec49f7c-31e1-4f0f-904a-ed728534c8a2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:01.702140 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3e5c283-68fe-44cc-b801-9d393f524392] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 54868. May 27 09:59:01.706080 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dec49f7c-31e1-4f0f-904a-ed728534c8a2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:01.706553 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dec49f7c-31e1-4f0f-904a-ed728534c8a2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:01.707313 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dec49f7c-31e1-4f0f-904a-ed728534c8a2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:01.707746 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dec49f7c-31e1-4f0f-904a-ed728534c8a2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:01.835706 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-dec49f7c-31e1-4f0f-904a-ed728534c8a2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:01.843993 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-dec49f7c-31e1-4f0f-904a-ed728534c8a2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.157741 May 27 09:59:01.844547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 533/1075] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:01 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:02.861534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e0c69056-f329-4f44-86de-0982355bd70b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:02.862041 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e0c69056-f329-4f44-86de-0982355bd70b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:02.868988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e0c69056-f329-4f44-86de-0982355bd70b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:02.869425 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e0c69056-f329-4f44-86de-0982355bd70b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:02.870174 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e0c69056-f329-4f44-86de-0982355bd70b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:02.870622 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e0c69056-f329-4f44-86de-0982355bd70b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:02.997023 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e0c69056-f329-4f44-86de-0982355bd70b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:03.004503 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e0c69056-f329-4f44-86de-0982355bd70b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.146881 May 27 09:59:03.005061 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 543/1076] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:02 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:04.022139 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-661f93f0-5b82-4bb8-bca2-dcd66630ed57 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:04.022779 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-661f93f0-5b82-4bb8-bca2-dcd66630ed57 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:04.030110 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-661f93f0-5b82-4bb8-bca2-dcd66630ed57 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:04.030997 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-661f93f0-5b82-4bb8-bca2-dcd66630ed57 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:04.031334 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-661f93f0-5b82-4bb8-bca2-dcd66630ed57 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:04.031765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-661f93f0-5b82-4bb8-bca2-dcd66630ed57 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:04.162020 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-661f93f0-5b82-4bb8-bca2-dcd66630ed57 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:04.169926 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-661f93f0-5b82-4bb8-bca2-dcd66630ed57 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.151633 May 27 09:59:04.170530 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 534/1077] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:04 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:05.187534 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5132482d-4297-4f51-94f6-48fb53036efa tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:05.188080 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5132482d-4297-4f51-94f6-48fb53036efa tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:05.194690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5132482d-4297-4f51-94f6-48fb53036efa tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:05.195136 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5132482d-4297-4f51-94f6-48fb53036efa tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:05.195925 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5132482d-4297-4f51-94f6-48fb53036efa tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:05.196358 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5132482d-4297-4f51-94f6-48fb53036efa tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:05.325124 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5132482d-4297-4f51-94f6-48fb53036efa tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:05.332681 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5132482d-4297-4f51-94f6-48fb53036efa tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.149169 May 27 09:59:05.333241 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 544/1078] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:05 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:06.350610 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e08a04c0-3ca6-45ca-b87f-442ea9ef25b7 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:06.351223 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e08a04c0-3ca6-45ca-b87f-442ea9ef25b7 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:06.361132 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e08a04c0-3ca6-45ca-b87f-442ea9ef25b7 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:06.361132 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e08a04c0-3ca6-45ca-b87f-442ea9ef25b7 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:06.361132 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e08a04c0-3ca6-45ca-b87f-442ea9ef25b7 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:06.361132 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e08a04c0-3ca6-45ca-b87f-442ea9ef25b7 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:06.488649 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e08a04c0-3ca6-45ca-b87f-442ea9ef25b7 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:06.496405 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e08a04c0-3ca6-45ca-b87f-442ea9ef25b7 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.149806 May 27 09:59:06.496977 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 535/1079] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:06 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:07.514156 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-41aab0a5-c6e0-4570-a6d4-29f5ba95eeb6 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:07.514771 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-41aab0a5-c6e0-4570-a6d4-29f5ba95eeb6 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:07.521257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41aab0a5-c6e0-4570-a6d4-29f5ba95eeb6 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:07.521714 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41aab0a5-c6e0-4570-a6d4-29f5ba95eeb6 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:07.522506 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41aab0a5-c6e0-4570-a6d4-29f5ba95eeb6 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:07.522950 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-41aab0a5-c6e0-4570-a6d4-29f5ba95eeb6 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:07.655675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-41aab0a5-c6e0-4570-a6d4-29f5ba95eeb6 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:07.663560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-41aab0a5-c6e0-4570-a6d4-29f5ba95eeb6 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.153306 May 27 09:59:07.664130 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 545/1080] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:07 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:08.682082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-dc008bf0-6b69-4b93-b8ce-997a8c277fe2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:08.682732 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-dc008bf0-6b69-4b93-b8ce-997a8c277fe2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:08.689283 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dc008bf0-6b69-4b93-b8ce-997a8c277fe2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:08.689733 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dc008bf0-6b69-4b93-b8ce-997a8c277fe2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:08.690531 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dc008bf0-6b69-4b93-b8ce-997a8c277fe2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:08.690963 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dc008bf0-6b69-4b93-b8ce-997a8c277fe2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:08.821743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-dc008bf0-6b69-4b93-b8ce-997a8c277fe2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:08.829804 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-dc008bf0-6b69-4b93-b8ce-997a8c277fe2 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.152128 May 27 09:59:08.830411 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 536/1081] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:08 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:09.847548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-a5ed3a74-f6fe-408e-a6e8-96b32fa6abae tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:09.848162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-a5ed3a74-f6fe-408e-a6e8-96b32fa6abae tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:09.855445 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a5ed3a74-f6fe-408e-a6e8-96b32fa6abae tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:09.855893 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a5ed3a74-f6fe-408e-a6e8-96b32fa6abae tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:09.856652 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a5ed3a74-f6fe-408e-a6e8-96b32fa6abae tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:09.857086 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-a5ed3a74-f6fe-408e-a6e8-96b32fa6abae tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:09.985484 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-a5ed3a74-f6fe-408e-a6e8-96b32fa6abae tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:09.993039 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-a5ed3a74-f6fe-408e-a6e8-96b32fa6abae tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.149339 May 27 09:59:09.994248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 546/1082] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:09 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:11.010866 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0bfae438-255b-46eb-ad84-4b1bade6c18b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:11.011461 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0bfae438-255b-46eb-ad84-4b1bade6c18b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:11.018025 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0bfae438-255b-46eb-ad84-4b1bade6c18b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:11.018514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0bfae438-255b-46eb-ad84-4b1bade6c18b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:11.019270 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0bfae438-255b-46eb-ad84-4b1bade6c18b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:11.019704 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0bfae438-255b-46eb-ad84-4b1bade6c18b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:11.150841 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0bfae438-255b-46eb-ad84-4b1bade6c18b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:11.158362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0bfae438-255b-46eb-ad84-4b1bade6c18b tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.151304 May 27 09:59:11.158946 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 537/1083] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:11 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:12.176058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-90231e81-6dcf-4d91-aa21-7ef318030545 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:12.176670 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-90231e81-6dcf-4d91-aa21-7ef318030545 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:12.183811 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-90231e81-6dcf-4d91-aa21-7ef318030545 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:12.184251 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-90231e81-6dcf-4d91-aa21-7ef318030545 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:12.185003 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-90231e81-6dcf-4d91-aa21-7ef318030545 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:12.185443 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-90231e81-6dcf-4d91-aa21-7ef318030545 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:12.574036 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-90231e81-6dcf-4d91-aa21-7ef318030545 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:12.578784 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-90231e81-6dcf-4d91-aa21-7ef318030545 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.406580 May 27 09:59:12.579341 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 547/1084] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:12 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:13.596547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-c0b39f97-bed5-489d-90a2-b15abdcdd3da tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:13.597160 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-c0b39f97-bed5-489d-90a2-b15abdcdd3da tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:13.604192 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c0b39f97-bed5-489d-90a2-b15abdcdd3da tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:13.604626 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c0b39f97-bed5-489d-90a2-b15abdcdd3da tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:13.605413 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c0b39f97-bed5-489d-90a2-b15abdcdd3da tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:13.605848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-c0b39f97-bed5-489d-90a2-b15abdcdd3da tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:13.732772 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-c0b39f97-bed5-489d-90a2-b15abdcdd3da tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:13.740289 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-c0b39f97-bed5-489d-90a2-b15abdcdd3da tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.147634 May 27 09:59:13.740851 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 538/1085] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:13 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:14.758069 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4b5f8f61-eef3-43ee-bc1c-1af244e5b364 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:14.758701 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4b5f8f61-eef3-43ee-bc1c-1af244e5b364 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:14.765719 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4b5f8f61-eef3-43ee-bc1c-1af244e5b364 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:14.766162 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4b5f8f61-eef3-43ee-bc1c-1af244e5b364 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:14.766998 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4b5f8f61-eef3-43ee-bc1c-1af244e5b364 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:14.767426 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4b5f8f61-eef3-43ee-bc1c-1af244e5b364 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:14.900699 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4b5f8f61-eef3-43ee-bc1c-1af244e5b364 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:14.908746 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4b5f8f61-eef3-43ee-bc1c-1af244e5b364 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.154503 May 27 09:59:14.909317 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 548/1086] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:14 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:15.926611 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d222b7ca-81fb-4e46-af7f-933f01c07a73 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:15.927166 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d222b7ca-81fb-4e46-af7f-933f01c07a73 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:15.933586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d222b7ca-81fb-4e46-af7f-933f01c07a73 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:15.934038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d222b7ca-81fb-4e46-af7f-933f01c07a73 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:15.934834 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d222b7ca-81fb-4e46-af7f-933f01c07a73 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:15.935271 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d222b7ca-81fb-4e46-af7f-933f01c07a73 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:16.065219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d222b7ca-81fb-4e46-af7f-933f01c07a73 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:16.073209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d222b7ca-81fb-4e46-af7f-933f01c07a73 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.150632 May 27 09:59:16.073767 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 539/1087] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:15 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:17.090976 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3907f8b9-ee95-462c-b4a6-b6113bf2438f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:17.091516 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3907f8b9-ee95-462c-b4a6-b6113bf2438f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:17.098098 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3907f8b9-ee95-462c-b4a6-b6113bf2438f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:17.098585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3907f8b9-ee95-462c-b4a6-b6113bf2438f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:17.099353 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3907f8b9-ee95-462c-b4a6-b6113bf2438f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:17.099795 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3907f8b9-ee95-462c-b4a6-b6113bf2438f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:17.236684 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3907f8b9-ee95-462c-b4a6-b6113bf2438f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:17.244491 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3907f8b9-ee95-462c-b4a6-b6113bf2438f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.157984 May 27 09:59:17.245227 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 549/1088] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:17 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:18.262533 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f5f6c933-3171-46d0-850d-78e64dd58163 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:18.263120 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f5f6c933-3171-46d0-850d-78e64dd58163 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:18.269525 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f5f6c933-3171-46d0-850d-78e64dd58163 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:18.269979 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f5f6c933-3171-46d0-850d-78e64dd58163 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:18.270777 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f5f6c933-3171-46d0-850d-78e64dd58163 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:18.271214 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f5f6c933-3171-46d0-850d-78e64dd58163 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:18.399240 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f5f6c933-3171-46d0-850d-78e64dd58163 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:18.407358 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f5f6c933-3171-46d0-850d-78e64dd58163 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1510 microversion: 2.1 time: 0.149217 May 27 09:59:18.407934 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 540/1089] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:18 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1510 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:18.424272 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f2418dd5-908f-433d-b100-7b93d259a1ce tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:59:18.424817 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f2418dd5-908f-433d-b100-7b93d259a1ce tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:18.430767 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f2418dd5-908f-433d-b100-7b93d259a1ce tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:18.431208 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f2418dd5-908f-433d-b100-7b93d259a1ce tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:18.431990 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f2418dd5-908f-433d-b100-7b93d259a1ce tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:18.432420 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f2418dd5-908f-433d-b100-7b93d259a1ce tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:18.818850 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f2418dd5-908f-433d-b100-7b93d259a1ce tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "POST /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9/action" status: 202 len: 0 microversion: 2.1 time: 0.393922 May 27 09:59:18.818850 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 550/1090] 10.222.0.48 () {60 vars in 1277 bytes} [Fri May 27 09:59:18 2022] POST /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 09:59:18.823722 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-dba41aed-e485-4831-b1bb-8ad019f8e384 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:18.824475 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-dba41aed-e485-4831-b1bb-8ad019f8e384 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:18.830501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dba41aed-e485-4831-b1bb-8ad019f8e384 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:18.830948 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dba41aed-e485-4831-b1bb-8ad019f8e384 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:18.831765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dba41aed-e485-4831-b1bb-8ad019f8e384 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:18.832193 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-dba41aed-e485-4831-b1bb-8ad019f8e384 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:18.971398 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-dba41aed-e485-4831-b1bb-8ad019f8e384 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:18.979638 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-dba41aed-e485-4831-b1bb-8ad019f8e384 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1518 microversion: 2.1 time: 0.160334 May 27 09:59:18.980305 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 541/1091] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:18 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:19.997417 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9c80186d-6c18-4ed1-852c-eeb159ae2e11 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:19.998030 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9c80186d-6c18-4ed1-852c-eeb159ae2e11 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:20.004081 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9c80186d-6c18-4ed1-852c-eeb159ae2e11 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:20.004523 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9c80186d-6c18-4ed1-852c-eeb159ae2e11 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:20.005276 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9c80186d-6c18-4ed1-852c-eeb159ae2e11 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:20.005706 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9c80186d-6c18-4ed1-852c-eeb159ae2e11 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:20.132589 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9c80186d-6c18-4ed1-852c-eeb159ae2e11 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:20.140206 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9c80186d-6c18-4ed1-852c-eeb159ae2e11 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1520 microversion: 2.1 time: 0.147168 May 27 09:59:20.140758 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 551/1092] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:19 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:20.244891 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-f15a9244-81db-4fc7-a46c-3ede858e5823 req-bb7186f5-92f0-4fd5-aa48-302c6db18df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbacef2f-7879-416e-9fc3-79d334cf4ed9", "name": "network-vif-unplugged", "status": "completed", "tag": "e2fa5975-c182-41a2-baed-897e42da75a1"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:59:20.254023 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-f15a9244-81db-4fc7-a46c-3ede858e5823 req-bb7186f5-92f0-4fd5-aa48-302c6db18df6 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:20.254540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-f15a9244-81db-4fc7-a46c-3ede858e5823 req-bb7186f5-92f0-4fd5-aa48-302c6db18df6 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:20.265681 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.compute.server_external_events [req-f15a9244-81db-4fc7-a46c-3ede858e5823 req-bb7186f5-92f0-4fd5-aa48-302c6db18df6 service nova] Unable to find a host for instance cbacef2f-7879-416e-9fc3-79d334cf4ed9. Dropping event network-vif-unplugged {{(pid=124828) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 27 09:59:20.266638 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-f15a9244-81db-4fc7-a46c-3ede858e5823 req-bb7186f5-92f0-4fd5-aa48-302c6db18df6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026591 May 27 09:59:20.267209 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 542/1093] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 27 09:59:21.158612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9b506af0-ce68-4b1e-a959-2a63082f9cf1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:21.159219 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9b506af0-ce68-4b1e-a959-2a63082f9cf1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:21.165949 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9b506af0-ce68-4b1e-a959-2a63082f9cf1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:21.166436 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9b506af0-ce68-4b1e-a959-2a63082f9cf1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:21.167188 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9b506af0-ce68-4b1e-a959-2a63082f9cf1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:21.167618 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9b506af0-ce68-4b1e-a959-2a63082f9cf1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:21.304650 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9b506af0-ce68-4b1e-a959-2a63082f9cf1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:21.312237 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9b506af0-ce68-4b1e-a959-2a63082f9cf1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.157567 May 27 09:59:21.312814 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 552/1094] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:21 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:22.328927 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-82c60173-973a-4992-a6ac-ce3460182f27 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:22.329549 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-82c60173-973a-4992-a6ac-ce3460182f27 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:22.336176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-82c60173-973a-4992-a6ac-ce3460182f27 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:22.336626 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-82c60173-973a-4992-a6ac-ce3460182f27 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:22.337389 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-82c60173-973a-4992-a6ac-ce3460182f27 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:22.338349 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-82c60173-973a-4992-a6ac-ce3460182f27 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:22.467320 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-82c60173-973a-4992-a6ac-ce3460182f27 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:22.474919 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-82c60173-973a-4992-a6ac-ce3460182f27 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.149929 May 27 09:59:22.475494 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 543/1095] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:22 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:23.492703 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-c3fb5d00-c56a-421c-9f80-21f75c0e19d8 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:23.493314 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-c3fb5d00-c56a-421c-9f80-21f75c0e19d8 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:23.499912 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c3fb5d00-c56a-421c-9f80-21f75c0e19d8 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:23.500411 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c3fb5d00-c56a-421c-9f80-21f75c0e19d8 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:23.501113 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c3fb5d00-c56a-421c-9f80-21f75c0e19d8 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:23.501549 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-c3fb5d00-c56a-421c-9f80-21f75c0e19d8 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:23.630871 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-c3fb5d00-c56a-421c-9f80-21f75c0e19d8 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:23.638805 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-c3fb5d00-c56a-421c-9f80-21f75c0e19d8 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.149938 May 27 09:59:23.639371 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 553/1096] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:23 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:24.656302 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-66ae53ea-7a53-4f0c-a8dd-3f1e5124f0f3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:24.656912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-66ae53ea-7a53-4f0c-a8dd-3f1e5124f0f3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:24.663410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-66ae53ea-7a53-4f0c-a8dd-3f1e5124f0f3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:24.663855 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-66ae53ea-7a53-4f0c-a8dd-3f1e5124f0f3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:24.664877 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-66ae53ea-7a53-4f0c-a8dd-3f1e5124f0f3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:24.665307 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-66ae53ea-7a53-4f0c-a8dd-3f1e5124f0f3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:24.797624 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-66ae53ea-7a53-4f0c-a8dd-3f1e5124f0f3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:24.805131 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-66ae53ea-7a53-4f0c-a8dd-3f1e5124f0f3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.152637 May 27 09:59:24.805699 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 544/1097] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:24 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:25.822502 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-495dcabb-bad5-4491-a279-f00020601741 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:25.823044 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-495dcabb-bad5-4491-a279-f00020601741 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:25.829544 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-495dcabb-bad5-4491-a279-f00020601741 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:25.829991 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-495dcabb-bad5-4491-a279-f00020601741 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:25.830769 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-495dcabb-bad5-4491-a279-f00020601741 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:25.831210 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-495dcabb-bad5-4491-a279-f00020601741 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:25.849059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:25.966148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-495dcabb-bad5-4491-a279-f00020601741 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:25.973640 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-495dcabb-bad5-4491-a279-f00020601741 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.155147 May 27 09:59:25.974245 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 554/1098] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:25 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:59:26.991973 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9c4372bd-5da7-40e2-8cf9-50bf9d603dbf tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:26.992583 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9c4372bd-5da7-40e2-8cf9-50bf9d603dbf tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:26.999751 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c4372bd-5da7-40e2-8cf9-50bf9d603dbf tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:27.000204 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c4372bd-5da7-40e2-8cf9-50bf9d603dbf tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:27.000956 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c4372bd-5da7-40e2-8cf9-50bf9d603dbf tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:27.001386 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9c4372bd-5da7-40e2-8cf9-50bf9d603dbf tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:27.129356 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9c4372bd-5da7-40e2-8cf9-50bf9d603dbf tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:27.137018 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9c4372bd-5da7-40e2-8cf9-50bf9d603dbf tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.148966 May 27 09:59:27.137586 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 545/1099] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:26 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 09:59:28.157163 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-30859bd1-b8c6-40dc-bfca-8df7b444cd52 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:28.158224 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-30859bd1-b8c6-40dc-bfca-8df7b444cd52 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:28.165224 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30859bd1-b8c6-40dc-bfca-8df7b444cd52 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:28.165678 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30859bd1-b8c6-40dc-bfca-8df7b444cd52 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:28.166474 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30859bd1-b8c6-40dc-bfca-8df7b444cd52 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:28.166951 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30859bd1-b8c6-40dc-bfca-8df7b444cd52 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:28.302564 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-30859bd1-b8c6-40dc-bfca-8df7b444cd52 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:28.310720 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-30859bd1-b8c6-40dc-bfca-8df7b444cd52 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.160923 May 27 09:59:28.311284 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 555/1100] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:28 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:29.328438 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-751ff3bc-559a-4bdd-85f6-4aa9ca52cc2a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:29.329043 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-751ff3bc-559a-4bdd-85f6-4aa9ca52cc2a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:29.335580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-751ff3bc-559a-4bdd-85f6-4aa9ca52cc2a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:29.336023 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-751ff3bc-559a-4bdd-85f6-4aa9ca52cc2a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:29.336810 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-751ff3bc-559a-4bdd-85f6-4aa9ca52cc2a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:29.337240 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-751ff3bc-559a-4bdd-85f6-4aa9ca52cc2a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:29.341659 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=81 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:29.469509 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-751ff3bc-559a-4bdd-85f6-4aa9ca52cc2a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:29.476957 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-751ff3bc-559a-4bdd-85f6-4aa9ca52cc2a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.152507 May 27 09:59:29.477518 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 546/1101] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:29 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:30.494412 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2f58ca49-86da-4552-8a20-851824a00ae4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:30.494985 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2f58ca49-86da-4552-8a20-851824a00ae4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:30.498247 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=33 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:30.503267 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2f58ca49-86da-4552-8a20-851824a00ae4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:30.503727 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2f58ca49-86da-4552-8a20-851824a00ae4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:30.504494 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2f58ca49-86da-4552-8a20-851824a00ae4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:30.504930 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2f58ca49-86da-4552-8a20-851824a00ae4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:30.645206 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2f58ca49-86da-4552-8a20-851824a00ae4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:30.652786 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2f58ca49-86da-4552-8a20-851824a00ae4 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.162362 May 27 09:59:30.653350 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 556/1102] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:30 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:31.669710 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6704feed-6839-4245-aafb-03f09203fe4e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:31.670344 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6704feed-6839-4245-aafb-03f09203fe4e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:31.676937 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6704feed-6839-4245-aafb-03f09203fe4e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:31.677399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6704feed-6839-4245-aafb-03f09203fe4e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:31.678136 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6704feed-6839-4245-aafb-03f09203fe4e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:31.678598 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6704feed-6839-4245-aafb-03f09203fe4e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:31.807121 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6704feed-6839-4245-aafb-03f09203fe4e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:31.815079 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6704feed-6839-4245-aafb-03f09203fe4e tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.149252 May 27 09:59:31.815638 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 547/1103] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:31 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:32.341641 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-6f626dd4-f134-42c2-af6f-8387f927c6a0 req-adc4bdfc-05dc-4883-8d3a-20392db91f2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbacef2f-7879-416e-9fc3-79d334cf4ed9", "name": "network-vif-plugged", "status": "completed", "tag": "e2fa5975-c182-41a2-baed-897e42da75a1"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 09:59:32.350859 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-6f626dd4-f134-42c2-af6f-8387f927c6a0 req-adc4bdfc-05dc-4883-8d3a-20392db91f2a service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:32.351295 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-6f626dd4-f134-42c2-af6f-8387f927c6a0 req-adc4bdfc-05dc-4883-8d3a-20392db91f2a service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:32.363018 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-6f626dd4-f134-42c2-af6f-8387f927c6a0 req-adc4bdfc-05dc-4883-8d3a-20392db91f2a service nova] Creating event network-vif-plugged:e2fa5975-c182-41a2-baed-897e42da75a1 for instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 on hv-cinder-82549 May 27 09:59:32.368095 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-6f626dd4-f134-42c2-af6f-8387f927c6a0 req-adc4bdfc-05dc-4883-8d3a-20392db91f2a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030711 May 27 09:59:32.368666 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 557/1104] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 09:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 09:59:32.832751 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-033cea68-8361-4808-be74-acc07e553ed1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:32.833382 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-033cea68-8361-4808-be74-acc07e553ed1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:32.835835 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=33 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 09:59:32.841258 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-033cea68-8361-4808-be74-acc07e553ed1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:32.841705 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-033cea68-8361-4808-be74-acc07e553ed1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:32.842498 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-033cea68-8361-4808-be74-acc07e553ed1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:32.842936 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-033cea68-8361-4808-be74-acc07e553ed1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:32.974514 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-033cea68-8361-4808-be74-acc07e553ed1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:32.981997 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-033cea68-8361-4808-be74-acc07e553ed1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.153109 May 27 09:59:32.982598 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 548/1105] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:32 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:34.000143 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-816d6303-a73f-4d08-8ceb-0961b515ab50 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:34.000894 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-816d6303-a73f-4d08-8ceb-0961b515ab50 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:34.007145 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-816d6303-a73f-4d08-8ceb-0961b515ab50 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:34.007597 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-816d6303-a73f-4d08-8ceb-0961b515ab50 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:34.008356 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-816d6303-a73f-4d08-8ceb-0961b515ab50 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:34.008798 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-816d6303-a73f-4d08-8ceb-0961b515ab50 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:34.139256 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-816d6303-a73f-4d08-8ceb-0961b515ab50 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:34.147051 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-816d6303-a73f-4d08-8ceb-0961b515ab50 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1576 microversion: 2.1 time: 0.151649 May 27 09:59:34.147681 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 558/1106] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:33 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:35.165305 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4cc98c5e-9cd8-478e-b644-5afb680c36db tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 09:59:35.165859 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4cc98c5e-9cd8-478e-b644-5afb680c36db tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 09:59:35.172387 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4cc98c5e-9cd8-478e-b644-5afb680c36db tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:35.172837 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4cc98c5e-9cd8-478e-b644-5afb680c36db tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:35.173606 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4cc98c5e-9cd8-478e-b644-5afb680c36db tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 09:59:35.174048 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4cc98c5e-9cd8-478e-b644-5afb680c36db tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 09:59:35.308414 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-4cc98c5e-9cd8-478e-b644-5afb680c36db tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 09:59:35.316743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4cc98c5e-9cd8-478e-b644-5afb680c36db tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1563 microversion: 2.1 time: 0.155549 May 27 09:59:35.317220 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 549/1107] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 09:59:35 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 09:59:54.940618 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 09:59:54.941296 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 09:59:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:01:04.987380 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=5 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:01:04.988755 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=22 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:01:04.990701 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:01:04.991623 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=23 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:01:04.993160 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-53e1f0a1-c168-4005-8781-a67144902d4a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:04.993888 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-53e1f0a1-c168-4005-8781-a67144902d4a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:01:05.017100 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-53e1f0a1-c168-4005-8781-a67144902d4a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:05.017100 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-53e1f0a1-c168-4005-8781-a67144902d4a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:05.017100 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-53e1f0a1-c168-4005-8781-a67144902d4a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:05.017100 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-53e1f0a1-c168-4005-8781-a67144902d4a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:05.029922 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-53e1f0a1-c168-4005-8781-a67144902d4a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 10:01:05.061460 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-d07fdcc0-11e0-4e9f-9b5d-313bec4e089a req-8d80cbc3-9bea-44ac-ba16-765bca71239c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbacef2f-7879-416e-9fc3-79d334cf4ed9", "tag": "e2fa5975-c182-41a2-baed-897e42da75a1"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:01:05.070420 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-d07fdcc0-11e0-4e9f-9b5d-313bec4e089a req-8d80cbc3-9bea-44ac-ba16-765bca71239c service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:05.070872 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-d07fdcc0-11e0-4e9f-9b5d-313bec4e089a req-8d80cbc3-9bea-44ac-ba16-765bca71239c service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:05.084833 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-d07fdcc0-11e0-4e9f-9b5d-313bec4e089a req-8d80cbc3-9bea-44ac-ba16-765bca71239c service nova] Creating event network-changed:e2fa5975-c182-41a2-baed-897e42da75a1 for instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 on hv-cinder-82549 May 27 10:01:05.090311 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR oslo.messaging._drivers.impl_rabbit [req-d07fdcc0-11e0-4e9f-9b5d-313bec4e089a req-8d80cbc3-9bea-44ac-ba16-765bca71239c service nova] [55fc2169-5ee1-4b1b-91b8-e99e0791f14a] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 10:01:05.408163 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-53e1f0a1-c168-4005-8781-a67144902d4a tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "DELETE /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 204 len: 0 microversion: 2.1 time: 0.422774 May 27 10:01:05.408850 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 559/1108] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 10:01:04 2022] DELETE /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 10:01:05.417657 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3ccebf4e-cb8e-46d5-a470-a402628c5cd3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:05.418439 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3ccebf4e-cb8e-46d5-a470-a402628c5cd3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:01:05.425013 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ccebf4e-cb8e-46d5-a470-a402628c5cd3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:05.430303 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ccebf4e-cb8e-46d5-a470-a402628c5cd3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:05.430303 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ccebf4e-cb8e-46d5-a470-a402628c5cd3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:05.430303 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3ccebf4e-cb8e-46d5-a470-a402628c5cd3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:05.564850 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3ccebf4e-cb8e-46d5-a470-a402628c5cd3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:01:05.574721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3ccebf4e-cb8e-46d5-a470-a402628c5cd3 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.159547 May 27 10:01:05.574721 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 560/1109] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:01:05 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:01:06.096748 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [req-d07fdcc0-11e0-4e9f-9b5d-313bec4e089a req-8d80cbc3-9bea-44ac-ba16-765bca71239c service nova] [55fc2169-5ee1-4b1b-91b8-e99e0791f14a] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 54990. May 27 10:01:06.100609 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-d07fdcc0-11e0-4e9f-9b5d-313bec4e089a req-8d80cbc3-9bea-44ac-ba16-765bca71239c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.111929 May 27 10:01:06.101215 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 550/1110] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:01:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 10:01:06.590959 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-d3af63e9-6e1c-4178-8e0f-b36fc69a0489 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:06.591574 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-d3af63e9-6e1c-4178-8e0f-b36fc69a0489 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:01:06.598632 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d3af63e9-6e1c-4178-8e0f-b36fc69a0489 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:06.599082 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d3af63e9-6e1c-4178-8e0f-b36fc69a0489 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:06.599844 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d3af63e9-6e1c-4178-8e0f-b36fc69a0489 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:06.600275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-d3af63e9-6e1c-4178-8e0f-b36fc69a0489 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:06.738900 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-d3af63e9-6e1c-4178-8e0f-b36fc69a0489 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:01:06.746609 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-d3af63e9-6e1c-4178-8e0f-b36fc69a0489 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1569 microversion: 2.1 time: 0.159473 May 27 10:01:06.747177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 561/1111] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:01:06 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 10:01:07.671463 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-cd9caf39-099e-422d-8ea5-cb7cd515a96c req-2bed7aa6-2675-4b4e-a8d8-43f435400900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbacef2f-7879-416e-9fc3-79d334cf4ed9", "name": "network-vif-deleted", "tag": "e2fa5975-c182-41a2-baed-897e42da75a1"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:01:07.680326 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-cd9caf39-099e-422d-8ea5-cb7cd515a96c req-2bed7aa6-2675-4b4e-a8d8-43f435400900 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:07.680775 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-cd9caf39-099e-422d-8ea5-cb7cd515a96c req-2bed7aa6-2675-4b4e-a8d8-43f435400900 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:07.691888 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-cd9caf39-099e-422d-8ea5-cb7cd515a96c req-2bed7aa6-2675-4b4e-a8d8-43f435400900 service nova] Creating event network-vif-deleted:e2fa5975-c182-41a2-baed-897e42da75a1 for instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 on hv-cinder-82549 May 27 10:01:07.697136 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-cd9caf39-099e-422d-8ea5-cb7cd515a96c req-2bed7aa6-2675-4b4e-a8d8-43f435400900 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083763 May 27 10:01:07.697719 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 551/1112] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:01:07.764419 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-1813ff4a-c0a9-452e-9b6b-c1e85b40ea5f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:07.765055 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-1813ff4a-c0a9-452e-9b6b-c1e85b40ea5f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:01:07.771555 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1813ff4a-c0a9-452e-9b6b-c1e85b40ea5f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:07.771998 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1813ff4a-c0a9-452e-9b6b-c1e85b40ea5f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:07.772762 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1813ff4a-c0a9-452e-9b6b-c1e85b40ea5f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:07.773192 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-1813ff4a-c0a9-452e-9b6b-c1e85b40ea5f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:07.841982 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-1813ff4a-c0a9-452e-9b6b-c1e85b40ea5f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:01:07.850401 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-1813ff4a-c0a9-452e-9b6b-c1e85b40ea5f tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1383 microversion: 2.1 time: 0.089833 May 27 10:01:07.850982 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 562/1113] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:01:07 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1383 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:01:08.868510 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:08.869238 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:01:08.875698 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:08.876679 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:08.877454 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:08.877889 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:08.908066 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:08.908539 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:08.908983 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.objects.instance [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lazy-loading 'fault' on Instance uuid cbacef2f-7879-416e-9fc3-79d334cf4ed9 {{(pid=124828) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 10:01:08.950450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43510113da604d528b4472ee77bc1061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd927de989e8244d19dc9d2f54da6738c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:01:08.958038 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d52c5156-9652-44f9-8552-cc2c1b4df95d tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 200 len: 1225 microversion: 2.1 time: 0.094329 May 27 10:01:08.958636 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 552/1114] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:01:08 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:01:09.975350 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b43b8993-8132-4c41-a4b1-29e9d68d4dd1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:09.975897 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b43b8993-8132-4c41-a4b1-29e9d68d4dd1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] [instance: cbacef2f-7879-416e-9fc3-79d334cf4ed9] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:01:09.982660 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b43b8993-8132-4c41-a4b1-29e9d68d4dd1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:09.983107 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b43b8993-8132-4c41-a4b1-29e9d68d4dd1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:09.983864 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b43b8993-8132-4c41-a4b1-29e9d68d4dd1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:09.984296 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b43b8993-8132-4c41-a4b1-29e9d68d4dd1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:09.997327 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-b43b8993-8132-4c41-a4b1-29e9d68d4dd1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] HTTP exception thrown: Instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 could not be found. May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b43b8993-8132-4c41-a4b1-29e9d68d4dd1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Request method failure captured: May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 HTTP/1.1 May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikKAkZTW3F9b5anFnw-z_iMJkESLTbwI333t5F-axlqtpBNyjv79oyFWFMzIdg1d_HHU94NiArCVtZUeSzVB10_oRzWNYXCuWHKPFljYLabC4AC8pf9yv6lSNV_p3Xb1L7HmYpqgDW5S6An2W2b4jIy4WNFFTuVUPt2BW1e1Lw6lczFM May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: d927de989e8244d19dc9d2f54da6738c May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-TestShelveInstance-190003708 May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 10:01:09.998979 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d927de989e8244d19dc9d2f54da6738c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d927de989e8244d19dc9d2f54da6738c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d927de989e8244d19dc9d2f54da6738c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d927de989e8244d19dc9d2f54da6738c", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-TestShelveInstance-190003708 May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: d927de989e8244d19dc9d2f54da6738c May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-TestShelveInstance-190003708 May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-TestShelveInstance-190003708-project May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: 43510113da604d528b4472ee77bc1061 May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-TestShelveInstance-190003708-project May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 could not be found. May 27 10:01:10.000690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': 'cbacef2f-7879-416e-9fc3-79d334cf4ed9'} May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 could not be found. May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 10:01:10.002257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 could not be found. May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 could not be found. May 27 10:01:10.003863 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 10:01:10.005497 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b43b8993-8132-4c41-a4b1-29e9d68d4dd1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Returning 404 to user: Instance cbacef2f-7879-416e-9fc3-79d334cf4ed9 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 10:01:10.005497 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b43b8993-8132-4c41-a4b1-29e9d68d4dd1 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9" status: 404 len: 111 microversion: 2.1 time: 0.028992 May 27 10:01:10.005497 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 563/1115] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:01:09 2022] GET /compute/v2.1/servers/cbacef2f-7879-416e-9fc3-79d334cf4ed9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 10:01:10.258412 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-dfc261fc-b400-4542-9a98-fa20347a7485 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] Calling method '.version_select at 0x7fbe323e23a0>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:10.341834 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-dfc261fc-b400-4542-9a98-fa20347a7485 tempest-TestShelveInstance-190003708 tempest-TestShelveInstance-190003708-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1240464613" status: 202 len: 0 microversion: 2.1 time: 0.087331 May 27 10:01:10.342463 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 553/1116] 10.222.0.48 () {58 vars in 1253 bytes} [Fri May 27 10:01:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1240464613 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 27 10:01:30.132478 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:01:30.132478 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 10:01:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:01:31.405514 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:01:31.406278 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:01:31.577257 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f8a70543-6658-411e-9f8b-84ecff05641c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Action: 'create', calling method: .version_select at 0x7fbe324d9790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-429678364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL51oBgrb1BNbQf6OCHWJfE843vlSDOdqRRBmcWO0NjXdEWEsMdaOgWS4Z4qRR2FspWrnYomTqEjax170z/NIxN2fUyGS+MbPclumLgluJMAJGCxhRyXraGQDixZXdDasQ=="}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:01:31.608686 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-f8a70543-6658-411e-9f8b-84ecff05641c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Getting quotas for project fb894beeec434e34b0a8224128eda0c1. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 10:01:31.613141 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-f8a70543-6658-411e-9f8b-84ecff05641c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Getting quotas for user ce5ba392d54f4d9588b7e3f891e8e331 and project fb894beeec434e34b0a8224128eda0c1. Resources: {'key_pairs'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 10:01:31.626005 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f8a70543-6658-411e-9f8b-84ecff05641c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [6db4ff7d-a1fe-4c7b-94a0-605109292603] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 10:01:32.632586 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [None req-f8a70543-6658-411e-9f8b-84ecff05641c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [6db4ff7d-a1fe-4c7b-94a0-605109292603] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55124. May 27 10:01:32.705075 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f8a70543-6658-411e-9f8b-84ecff05641c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.304347 May 27 10:01:32.705666 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 564/1117] 10.222.0.48 () {60 vars in 1158 bytes} [Fri May 27 10:01:31 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:01:43.655297 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:01:43.655957 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 10:01:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:01:54.951467 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=12 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:01:54.952217 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:01:54.956138 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-599618708", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-429678364", "security_groups": [{"name": "tempest-secgroup-smoke-1263524947"}], "block_device_mapping_v2": [{"uuid": "64442757-0145-4d4b-afee-1f58cb37276a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43507242-c736-4ecc-9d32-b672049951e6"}]}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:01:55.215915 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] validate_networks() for [('43507242-c736-4ecc-9d32-b672049951e6', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 10:01:55.682056 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 10:01:55.682515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 10:01:55.682994 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 10:01:55.683428 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 10:01:55.683843 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 10:01:55.693077 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:55.693524 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:55.694363 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:55.694801 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:55.711455 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Getting quotas for project fb894beeec434e34b0a8224128eda0c1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 10:01:55.715373 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Getting quotas for user ce5ba392d54f4d9588b7e3f891e8e331 and project fb894beeec434e34b0a8224128eda0c1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 10:01:55.772401 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 10:01:55.774546 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='64442757-0145-4d4b-afee-1f58cb37276a',volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 10:01:56.146322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5310478a-c7cf-4e59-aa6f-46036f9fe9f6 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.196036 May 27 10:01:56.147010 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 554/1118] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 10:01:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1197 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 27 10:01:56.154654 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=4 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:01:56.155418 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:01:56.160723 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5f6ad228-a093-4413-aac1-9db8f6e29c20 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:56.162039 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5f6ad228-a093-4413-aac1-9db8f6e29c20 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:01:56.215489 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5f6ad228-a093-4413-aac1-9db8f6e29c20 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:01:56.221993 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5f6ad228-a093-4413-aac1-9db8f6e29c20 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1093 microversion: 2.1 time: 0.068856 May 27 10:01:56.222588 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 565/1119] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:01:56 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:01:57.240077 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8877007b-7dad-4291-b494-8c44961dfd4a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:57.240684 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8877007b-7dad-4291-b494-8c44961dfd4a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:01:57.247355 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8877007b-7dad-4291-b494-8c44961dfd4a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:57.247798 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8877007b-7dad-4291-b494-8c44961dfd4a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:57.248549 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8877007b-7dad-4291-b494-8c44961dfd4a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:57.248981 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8877007b-7dad-4291-b494-8c44961dfd4a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:57.311061 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8877007b-7dad-4291-b494-8c44961dfd4a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:01:57.318762 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8877007b-7dad-4291-b494-8c44961dfd4a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1143 microversion: 2.1 time: 0.083691 May 27 10:01:57.319327 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 555/1120] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:01:57 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1143 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:01:58.338331 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-705b50da-63a8-4901-8c7c-a61e19c47610 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:58.339172 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-705b50da-63a8-4901-8c7c-a61e19c47610 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:01:58.349525 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-705b50da-63a8-4901-8c7c-a61e19c47610 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:58.390837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-705b50da-63a8-4901-8c7c-a61e19c47610 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:58.390837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-705b50da-63a8-4901-8c7c-a61e19c47610 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:58.390837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-705b50da-63a8-4901-8c7c-a61e19c47610 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:58.441237 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-705b50da-63a8-4901-8c7c-a61e19c47610 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:01:58.448651 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-705b50da-63a8-4901-8c7c-a61e19c47610 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1199 microversion: 2.1 time: 0.116280 May 27 10:01:58.449241 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 566/1121] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:01:58 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1199 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:01:59.466399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-64175b5f-93a3-4e96-9c30-bb8223c4a608 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:01:59.467042 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-64175b5f-93a3-4e96-9c30-bb8223c4a608 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:01:59.473932 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-64175b5f-93a3-4e96-9c30-bb8223c4a608 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:59.474432 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-64175b5f-93a3-4e96-9c30-bb8223c4a608 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:59.475214 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-64175b5f-93a3-4e96-9c30-bb8223c4a608 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:59.475685 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-64175b5f-93a3-4e96-9c30-bb8223c4a608 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:59.609493 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-64175b5f-93a3-4e96-9c30-bb8223c4a608 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:01:59.617075 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-64175b5f-93a3-4e96-9c30-bb8223c4a608 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1277 microversion: 2.1 time: 0.154796 May 27 10:01:59.617644 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 556/1122] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:01:59 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:01:59.966051 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-13493643-077f-4759-900d-2bcd9b47f72c req-99bcb171-9f79-4525-8665-f097b888dc3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51149850-0b50-45f8-b705-f8b87fe14768", "tag": "a1b1e94b-f72b-4bad-8253-75ddb23396da"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:01:59.976321 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-13493643-077f-4759-900d-2bcd9b47f72c req-99bcb171-9f79-4525-8665-f097b888dc3f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:01:59.981028 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-13493643-077f-4759-900d-2bcd9b47f72c req-99bcb171-9f79-4525-8665-f097b888dc3f service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:01:59.992123 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-13493643-077f-4759-900d-2bcd9b47f72c req-99bcb171-9f79-4525-8665-f097b888dc3f service nova] Creating event network-changed:a1b1e94b-f72b-4bad-8253-75ddb23396da for instance 51149850-0b50-45f8-b705-f8b87fe14768 on hv-cinder-82549 May 27 10:01:59.997281 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-13493643-077f-4759-900d-2bcd9b47f72c req-99bcb171-9f79-4525-8665-f097b888dc3f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035070 May 27 10:01:59.997994 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 567/1123] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:02:00.634138 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-430bda66-d4ea-4da4-bf49-17ddc2df682f tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:00.634774 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-430bda66-d4ea-4da4-bf49-17ddc2df682f tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:00.641182 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-430bda66-d4ea-4da4-bf49-17ddc2df682f tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:00.641654 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-430bda66-d4ea-4da4-bf49-17ddc2df682f tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:00.642571 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-430bda66-d4ea-4da4-bf49-17ddc2df682f tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:00.643009 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-430bda66-d4ea-4da4-bf49-17ddc2df682f tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:00.775177 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-430bda66-d4ea-4da4-bf49-17ddc2df682f tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:00.783158 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-430bda66-d4ea-4da4-bf49-17ddc2df682f tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.152222 May 27 10:02:00.783727 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 557/1124] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:00 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:01.801572 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-30b66b5c-8ac1-45b6-a60e-e4c490e368e5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:01.802301 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-30b66b5c-8ac1-45b6-a60e-e4c490e368e5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:01.809059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30b66b5c-8ac1-45b6-a60e-e4c490e368e5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:01.809508 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30b66b5c-8ac1-45b6-a60e-e4c490e368e5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:01.810315 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30b66b5c-8ac1-45b6-a60e-e4c490e368e5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:01.810759 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-30b66b5c-8ac1-45b6-a60e-e4c490e368e5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:01.939311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-30b66b5c-8ac1-45b6-a60e-e4c490e368e5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:01.946682 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-30b66b5c-8ac1-45b6-a60e-e4c490e368e5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.149827 May 27 10:02:01.947243 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 568/1125] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:01 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:02.963537 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-ff0c70c6-6dfa-4793-bf8e-4c196743b73d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:02.964162 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-ff0c70c6-6dfa-4793-bf8e-4c196743b73d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:02.970738 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ff0c70c6-6dfa-4793-bf8e-4c196743b73d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:02.971188 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ff0c70c6-6dfa-4793-bf8e-4c196743b73d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:02.971949 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ff0c70c6-6dfa-4793-bf8e-4c196743b73d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:02.972388 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-ff0c70c6-6dfa-4793-bf8e-4c196743b73d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:03.101476 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-ff0c70c6-6dfa-4793-bf8e-4c196743b73d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:03.109082 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-ff0c70c6-6dfa-4793-bf8e-4c196743b73d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.149529 May 27 10:02:03.109796 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 558/1126] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:02 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:04.127440 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2db9a417-e92e-4639-a92a-95deed1f3182 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:04.128038 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2db9a417-e92e-4639-a92a-95deed1f3182 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:04.134513 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2db9a417-e92e-4639-a92a-95deed1f3182 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:04.134958 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2db9a417-e92e-4639-a92a-95deed1f3182 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:04.135714 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2db9a417-e92e-4639-a92a-95deed1f3182 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:04.136143 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2db9a417-e92e-4639-a92a-95deed1f3182 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:04.261520 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2db9a417-e92e-4639-a92a-95deed1f3182 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:04.269454 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2db9a417-e92e-4639-a92a-95deed1f3182 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.146606 May 27 10:02:04.270318 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 569/1127] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:04 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:05.287298 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-46cc9d59-f0cf-49f8-b167-fbae352ceac1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:05.287910 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-46cc9d59-f0cf-49f8-b167-fbae352ceac1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:05.294440 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-46cc9d59-f0cf-49f8-b167-fbae352ceac1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:05.299062 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-46cc9d59-f0cf-49f8-b167-fbae352ceac1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:05.299062 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-46cc9d59-f0cf-49f8-b167-fbae352ceac1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:05.299062 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-46cc9d59-f0cf-49f8-b167-fbae352ceac1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:05.428459 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-46cc9d59-f0cf-49f8-b167-fbae352ceac1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:05.435841 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-46cc9d59-f0cf-49f8-b167-fbae352ceac1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.152601 May 27 10:02:05.436399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 559/1128] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:05 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:06.452253 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5ebf0c3e-f123-48e2-b959-ba9f19b554fd tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:06.452855 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5ebf0c3e-f123-48e2-b959-ba9f19b554fd tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:06.459560 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5ebf0c3e-f123-48e2-b959-ba9f19b554fd tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:06.459955 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5ebf0c3e-f123-48e2-b959-ba9f19b554fd tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:06.460716 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5ebf0c3e-f123-48e2-b959-ba9f19b554fd tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:06.461153 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5ebf0c3e-f123-48e2-b959-ba9f19b554fd tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:06.591719 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5ebf0c3e-f123-48e2-b959-ba9f19b554fd tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:06.599548 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5ebf0c3e-f123-48e2-b959-ba9f19b554fd tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.151141 May 27 10:02:06.600115 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 570/1129] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:06 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:07.616185 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-d4187a4d-75fb-4e57-adb3-63d616398d60 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:07.616797 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-d4187a4d-75fb-4e57-adb3-63d616398d60 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:07.618671 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:02:07.619356 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=6 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:02:07.624651 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d4187a4d-75fb-4e57-adb3-63d616398d60 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:07.625102 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d4187a4d-75fb-4e57-adb3-63d616398d60 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:07.626379 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d4187a4d-75fb-4e57-adb3-63d616398d60 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:07.626813 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-d4187a4d-75fb-4e57-adb3-63d616398d60 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:07.754100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-d4187a4d-75fb-4e57-adb3-63d616398d60 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:07.761507 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-d4187a4d-75fb-4e57-adb3-63d616398d60 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.149146 May 27 10:02:07.762064 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 560/1130] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:07 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:08.779136 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-68428bd1-e5c3-47fd-9ba9-34f141f53d2a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:08.779752 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-68428bd1-e5c3-47fd-9ba9-34f141f53d2a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:08.783335 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:02:08.788605 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-68428bd1-e5c3-47fd-9ba9-34f141f53d2a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:08.789057 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-68428bd1-e5c3-47fd-9ba9-34f141f53d2a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:08.789813 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-68428bd1-e5c3-47fd-9ba9-34f141f53d2a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:08.790330 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-68428bd1-e5c3-47fd-9ba9-34f141f53d2a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:08.919504 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-68428bd1-e5c3-47fd-9ba9-34f141f53d2a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:08.926906 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-68428bd1-e5c3-47fd-9ba9-34f141f53d2a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.151974 May 27 10:02:08.927462 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 571/1131] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:08 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:09.943657 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-362d76e8-897e-4f84-a4a4-3848dfd43f58 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:09.944269 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-362d76e8-897e-4f84-a4a4-3848dfd43f58 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:09.950749 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-362d76e8-897e-4f84-a4a4-3848dfd43f58 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:09.951201 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-362d76e8-897e-4f84-a4a4-3848dfd43f58 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:09.951970 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-362d76e8-897e-4f84-a4a4-3848dfd43f58 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:09.952413 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-362d76e8-897e-4f84-a4a4-3848dfd43f58 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:10.082568 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-362d76e8-897e-4f84-a4a4-3848dfd43f58 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:10.089987 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-362d76e8-897e-4f84-a4a4-3848dfd43f58 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.150276 May 27 10:02:10.090575 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 561/1132] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:09 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:11.107672 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b9df2417-d7ef-4bfa-9a97-7bb101e4bee0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:11.108342 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b9df2417-d7ef-4bfa-9a97-7bb101e4bee0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:11.115293 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b9df2417-d7ef-4bfa-9a97-7bb101e4bee0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:11.115733 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b9df2417-d7ef-4bfa-9a97-7bb101e4bee0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:11.116490 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b9df2417-d7ef-4bfa-9a97-7bb101e4bee0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:11.116922 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b9df2417-d7ef-4bfa-9a97-7bb101e4bee0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:11.255647 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b9df2417-d7ef-4bfa-9a97-7bb101e4bee0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:11.263923 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b9df2417-d7ef-4bfa-9a97-7bb101e4bee0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.160192 May 27 10:02:11.264513 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 572/1133] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:11 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:11.444138 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-b57093e3-ea5f-4e4f-b5ad-ed09883ff521 req-563cd9ed-4759-4d96-9dc3-e68dfeb8d1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51149850-0b50-45f8-b705-f8b87fe14768", "name": "network-vif-plugged", "status": "completed", "tag": "a1b1e94b-f72b-4bad-8253-75ddb23396da"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:02:11.452549 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-b57093e3-ea5f-4e4f-b5ad-ed09883ff521 req-563cd9ed-4759-4d96-9dc3-e68dfeb8d1a6 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:11.452992 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-b57093e3-ea5f-4e4f-b5ad-ed09883ff521 req-563cd9ed-4759-4d96-9dc3-e68dfeb8d1a6 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:11.463948 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-b57093e3-ea5f-4e4f-b5ad-ed09883ff521 req-563cd9ed-4759-4d96-9dc3-e68dfeb8d1a6 service nova] Creating event network-vif-plugged:a1b1e94b-f72b-4bad-8253-75ddb23396da for instance 51149850-0b50-45f8-b705-f8b87fe14768 on hv-cinder-82549 May 27 10:02:11.469014 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-b57093e3-ea5f-4e4f-b5ad-ed09883ff521 req-563cd9ed-4759-4d96-9dc3-e68dfeb8d1a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088254 May 27 10:02:11.470147 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 562/1134] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:02:12.281442 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e064bda0-3d5d-43b1-b4b0-17a0c6bc83e2 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:12.282055 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e064bda0-3d5d-43b1-b4b0-17a0c6bc83e2 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:12.288859 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e064bda0-3d5d-43b1-b4b0-17a0c6bc83e2 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:12.289295 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e064bda0-3d5d-43b1-b4b0-17a0c6bc83e2 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:12.290115 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e064bda0-3d5d-43b1-b4b0-17a0c6bc83e2 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:12.290564 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e064bda0-3d5d-43b1-b4b0-17a0c6bc83e2 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:12.421054 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e064bda0-3d5d-43b1-b4b0-17a0c6bc83e2 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:12.429024 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e064bda0-3d5d-43b1-b4b0-17a0c6bc83e2 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.151398 May 27 10:02:12.429580 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 573/1135] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:12 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:13.446396 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-6438bdfc-ae33-4c1c-b90d-3a610400e29e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:13.447097 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-6438bdfc-ae33-4c1c-b90d-3a610400e29e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:13.453360 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6438bdfc-ae33-4c1c-b90d-3a610400e29e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:13.453822 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6438bdfc-ae33-4c1c-b90d-3a610400e29e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:13.455208 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6438bdfc-ae33-4c1c-b90d-3a610400e29e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:13.455648 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-6438bdfc-ae33-4c1c-b90d-3a610400e29e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:13.591622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-6438bdfc-ae33-4c1c-b90d-3a610400e29e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:13.599545 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-6438bdfc-ae33-4c1c-b90d-3a610400e29e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1265 microversion: 2.1 time: 0.157929 May 27 10:02:13.600117 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 563/1136] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:13 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:14.616692 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9f2acb5f-4f3e-428e-b51d-6362d98e4a37 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:14.617303 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9f2acb5f-4f3e-428e-b51d-6362d98e4a37 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:14.623814 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f2acb5f-4f3e-428e-b51d-6362d98e4a37 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:14.624256 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f2acb5f-4f3e-428e-b51d-6362d98e4a37 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:14.625002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f2acb5f-4f3e-428e-b51d-6362d98e4a37 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:14.625431 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9f2acb5f-4f3e-428e-b51d-6362d98e4a37 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:14.751437 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9f2acb5f-4f3e-428e-b51d-6362d98e4a37 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:14.758828 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9f2acb5f-4f3e-428e-b51d-6362d98e4a37 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1451 microversion: 2.1 time: 0.145959 May 27 10:02:14.759385 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 574/1137] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:14 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:14.775281 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-3ac9d12a-2d13-481e-820b-f523af381531 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:02:14.775900 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-3ac9d12a-2d13-481e-820b-f523af381531 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:02:14.782916 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ac9d12a-2d13-481e-820b-f523af381531 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:14.783365 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ac9d12a-2d13-481e-820b-f523af381531 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:14.784119 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ac9d12a-2d13-481e-820b-f523af381531 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:14.784547 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-3ac9d12a-2d13-481e-820b-f523af381531 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:14.912512 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-3ac9d12a-2d13-481e-820b-f523af381531 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:02:14.920453 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-3ac9d12a-2d13-481e-820b-f523af381531 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1451 microversion: 2.1 time: 0.148938 May 27 10:02:14.921023 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 564/1138] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:02:14 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:02:16.781118 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-dd2341fb-f661-4abb-8549-9493be051b45 req-7768ca65-1472-4fc9-8155-650a0fdf26be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51149850-0b50-45f8-b705-f8b87fe14768", "tag": "a1b1e94b-f72b-4bad-8253-75ddb23396da"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:02:16.790441 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-dd2341fb-f661-4abb-8549-9493be051b45 req-7768ca65-1472-4fc9-8155-650a0fdf26be service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:02:16.790886 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-dd2341fb-f661-4abb-8549-9493be051b45 req-7768ca65-1472-4fc9-8155-650a0fdf26be service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:02:16.802325 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-dd2341fb-f661-4abb-8549-9493be051b45 req-7768ca65-1472-4fc9-8155-650a0fdf26be service nova] Creating event network-changed:a1b1e94b-f72b-4bad-8253-75ddb23396da for instance 51149850-0b50-45f8-b705-f8b87fe14768 on hv-cinder-82549 May 27 10:02:16.807385 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-dd2341fb-f661-4abb-8549-9493be051b45 req-7768ca65-1472-4fc9-8155-650a0fdf26be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030134 May 27 10:02:16.808049 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 575/1139] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:04:30.634861 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:04:30.635620 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=58 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:04:30.639972 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2bacf6e1-f963-4527-b980-9779013c8f81 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:30.640465 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2bacf6e1-f963-4527-b980-9779013c8f81 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:30.646954 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bacf6e1-f963-4527-b980-9779013c8f81 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:30.650559 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bacf6e1-f963-4527-b980-9779013c8f81 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:30.650559 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bacf6e1-f963-4527-b980-9779013c8f81 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:30.650559 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bacf6e1-f963-4527-b980-9779013c8f81 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:30.675166 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2bacf6e1-f963-4527-b980-9779013c8f81 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 10:04:30.892400 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2bacf6e1-f963-4527-b980-9779013c8f81 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 204 len: 0 microversion: 2.1 time: 0.258429 May 27 10:04:30.892912 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 565/1140] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 10:04:30 2022] DELETE /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 10:04:30.899108 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b291220a-e50b-4a38-a0f0-e73535eef307] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 27 10:04:30.899697 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=24 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:04:30.900435 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=52 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:04:30.904776 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-0b0b0af5-d9e4-4475-a76e-d275d4bd1cde tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:30.905473 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-0b0b0af5-d9e4-4475-a76e-d275d4bd1cde tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:30.911462 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0b0b0af5-d9e4-4475-a76e-d275d4bd1cde tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:30.912294 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0b0b0af5-d9e4-4475-a76e-d275d4bd1cde tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:30.912968 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0b0b0af5-d9e4-4475-a76e-d275d4bd1cde tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:30.913404 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-0b0b0af5-d9e4-4475-a76e-d275d4bd1cde tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:31.093181 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-0b0b0af5-d9e4-4475-a76e-d275d4bd1cde tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:31.101262 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-0b0b0af5-d9e4-4475-a76e-d275d4bd1cde tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1576 microversion: 2.1 time: 0.203986 May 27 10:04:31.101852 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 576/1141] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:30 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:32.119260 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1901d99c-caeb-429d-a926-3b5da5c27719 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:32.119965 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1901d99c-caeb-429d-a926-3b5da5c27719 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:32.127708 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1901d99c-caeb-429d-a926-3b5da5c27719 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:32.128161 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1901d99c-caeb-429d-a926-3b5da5c27719 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:32.128926 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1901d99c-caeb-429d-a926-3b5da5c27719 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:32.129364 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1901d99c-caeb-429d-a926-3b5da5c27719 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:32.263092 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-1901d99c-caeb-429d-a926-3b5da5c27719 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:32.270693 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1901d99c-caeb-429d-a926-3b5da5c27719 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1576 microversion: 2.1 time: 0.155852 May 27 10:04:32.271253 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 566/1142] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:32 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:33.288756 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2c030176-1a04-47fc-97dd-7c7a8814ca27 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:33.289399 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2c030176-1a04-47fc-97dd-7c7a8814ca27 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:33.299806 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c030176-1a04-47fc-97dd-7c7a8814ca27 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:33.300260 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c030176-1a04-47fc-97dd-7c7a8814ca27 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:33.301026 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c030176-1a04-47fc-97dd-7c7a8814ca27 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:33.301457 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c030176-1a04-47fc-97dd-7c7a8814ca27 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:33.305111 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] [b291220a-e50b-4a38-a0f0-e73535eef307] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55380. May 27 10:04:33.384843 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2c030176-1a04-47fc-97dd-7c7a8814ca27 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:33.392841 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2c030176-1a04-47fc-97dd-7c7a8814ca27 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1508 microversion: 2.1 time: 0.108389 May 27 10:04:33.400526 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 577/1143] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:33 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1508 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:33.493672 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-2022326b-0e4a-49c2-9cf8-8c026aa998d4 req-8de98f2a-cb62-4031-83c9-80edc32b3b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51149850-0b50-45f8-b705-f8b87fe14768", "name": "network-vif-deleted", "tag": "a1b1e94b-f72b-4bad-8253-75ddb23396da"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:04:33.502810 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-2022326b-0e4a-49c2-9cf8-8c026aa998d4 req-8de98f2a-cb62-4031-83c9-80edc32b3b22 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:33.503362 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-2022326b-0e4a-49c2-9cf8-8c026aa998d4 req-8de98f2a-cb62-4031-83c9-80edc32b3b22 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:33.514240 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-2022326b-0e4a-49c2-9cf8-8c026aa998d4 req-8de98f2a-cb62-4031-83c9-80edc32b3b22 service nova] Creating event network-vif-deleted:a1b1e94b-f72b-4bad-8253-75ddb23396da for instance 51149850-0b50-45f8-b705-f8b87fe14768 on hv-cinder-82549 May 27 10:04:33.519968 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-2022326b-0e4a-49c2-9cf8-8c026aa998d4 req-8de98f2a-cb62-4031-83c9-80edc32b3b22 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030320 May 27 10:04:33.522040 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 567/1144] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:04:34.409613 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:34.410263 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:34.417197 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:34.417675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:34.418476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:34.418915 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:34.458026 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:34.458503 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:34.458958 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lazy-loading 'fault' on Instance uuid 51149850-0b50-45f8-b705-f8b87fe14768 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 10:04:34.501761 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:34.509511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5628e332-e1db-4ed9-89be-90c4f7650019 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 200 len: 1229 microversion: 2.1 time: 0.103755 May 27 10:04:34.514646 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 578/1145] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:34 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:35.528103 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-85174283-31dd-487c-978e-1173921ebacc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:35.528806 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-85174283-31dd-487c-978e-1173921ebacc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:35.535685 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-85174283-31dd-487c-978e-1173921ebacc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:35.536134 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-85174283-31dd-487c-978e-1173921ebacc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:35.537153 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-85174283-31dd-487c-978e-1173921ebacc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:35.537599 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-85174283-31dd-487c-978e-1173921ebacc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:35.550878 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-85174283-31dd-487c-978e-1173921ebacc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] HTTP exception thrown: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-85174283-31dd-487c-978e-1173921ebacc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Request method failure captured: May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 HTTP/1.1 May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikKF1fFhRZe7yxXme7VVQkO_-55UXOBGijikvi4V_os1FR_QpSugoOdaBa3EsXQTDbfvvzWNOU1n4GIZCZlxWOnOt8ikJnie45FB5frkizKACCLFhZx3kmO4ozAGY8BHVml_L__KwyMImIUrUlI6AKS1wAVysiLbbDDRiWNvTI4iCyrM May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: fb894beeec434e34b0a8224128eda0c1 May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-TestVolumeBootPattern-1126995217 May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 10:04:35.552563 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fb894beeec434e34b0a8224128eda0c1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-TestVolumeBootPattern-1126995217 May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: fb894beeec434e34b0a8224128eda0c1 May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126995217 May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-TestVolumeBootPattern-1126995217-project May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: ce5ba392d54f4d9588b7e3f891e8e331 May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-TestVolumeBootPattern-1126995217-project May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:04:35.554219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '51149850-0b50-45f8-b705-f8b87fe14768'} May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 10:04:35.555515 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:04:35.557218 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:04:35.558811 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-85174283-31dd-487c-978e-1173921ebacc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Returning 404 to user: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 10:04:35.558811 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-85174283-31dd-487c-978e-1173921ebacc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 404 len: 111 microversion: 2.1 time: 0.030646 May 27 10:04:35.558811 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 568/1146] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:35 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 10:04:35.601148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-908030319", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-429678364", "security_groups": [{"name": "tempest-secgroup-smoke-1263524947"}], "block_device_mapping_v2": [{"uuid": "64442757-0145-4d4b-afee-1f58cb37276a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43507242-c736-4ecc-9d32-b672049951e6"}]}} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:04:35.711861 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.network.neutron [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] validate_networks() for [('43507242-c736-4ecc-9d32-b672049951e6', None, None, None, None, None)] {{(pid=124829) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 10:04:36.373275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Flavor limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 10:04:36.373275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Image limits 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 10:04:36.373275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Flavor pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 10:04:36.373275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Image pref 0:0:0 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 10:04:36.373275 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.virt.hardware [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124829) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 10:04:36.375295 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:36.375748 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:36.376543 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:36.376988 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:36.393862 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Getting quotas for project fb894beeec434e34b0a8224128eda0c1. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 10:04:36.397841 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.quota [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Getting quotas for user ce5ba392d54f4d9588b7e3f891e8e331 and project fb894beeec434e34b0a8224128eda0c1. Resources: {'cores', 'ram', 'instances'} {{(pid=124829) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 10:04:36.454972 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Going to run 1 instances... {{(pid=124829) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 10:04:36.457056 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='64442757-0145-4d4b-afee-1f58cb37276a',volume_size=None,volume_type=None)] {{(pid=124829) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 10:04:36.857449 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-335c5bce-bfce-43e6-8b93-dfdb13961d31 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.260009 May 27 10:04:36.858074 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 579/1147] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 10:04:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 10:04:36.868161 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-73abf5a3-4a4a-4e35-85d0-d434bc90f4ec tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:36.868765 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-73abf5a3-4a4a-4e35-85d0-d434bc90f4ec tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:36.922998 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-73abf5a3-4a4a-4e35-85d0-d434bc90f4ec tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:36.929580 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-73abf5a3-4a4a-4e35-85d0-d434bc90f4ec tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1093 microversion: 2.1 time: 0.065330 May 27 10:04:36.930163 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 569/1148] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:36 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:37.947583 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-f18990db-d507-41ed-9066-632bbe17514c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:37.948201 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-f18990db-d507-41ed-9066-632bbe17514c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:37.955059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f18990db-d507-41ed-9066-632bbe17514c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:37.955511 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f18990db-d507-41ed-9066-632bbe17514c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:37.956283 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f18990db-d507-41ed-9066-632bbe17514c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:37.956728 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-f18990db-d507-41ed-9066-632bbe17514c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:38.016114 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-f18990db-d507-41ed-9066-632bbe17514c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:38.024161 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-f18990db-d507-41ed-9066-632bbe17514c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1135 microversion: 2.1 time: 0.080830 May 27 10:04:38.025316 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 580/1149] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:37 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1135 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:39.045847 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-f21417df-b1d1-4c4b-8ec2-0770faf451d1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:39.046474 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-f21417df-b1d1-4c4b-8ec2-0770faf451d1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:39.053461 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f21417df-b1d1-4c4b-8ec2-0770faf451d1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:39.053915 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f21417df-b1d1-4c4b-8ec2-0770faf451d1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:39.054783 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f21417df-b1d1-4c4b-8ec2-0770faf451d1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:39.055222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-f21417df-b1d1-4c4b-8ec2-0770faf451d1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:39.116123 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-f21417df-b1d1-4c4b-8ec2-0770faf451d1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:39.125018 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-f21417df-b1d1-4c4b-8ec2-0770faf451d1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1209 microversion: 2.1 time: 0.082980 May 27 10:04:39.126080 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 570/1150] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:39 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:40.145067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-2c484f5e-53e8-4842-807c-3498575d9896 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:40.145676 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-2c484f5e-53e8-4842-807c-3498575d9896 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:40.152177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c484f5e-53e8-4842-807c-3498575d9896 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:40.152625 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c484f5e-53e8-4842-807c-3498575d9896 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:40.153388 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c484f5e-53e8-4842-807c-3498575d9896 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:40.153822 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-2c484f5e-53e8-4842-807c-3498575d9896 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:40.321863 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-dd1e4f62-e56c-4028-aa07-7bfafb8ecdc6 req-d61361fc-42f6-4b1c-987a-221b29e8f1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1172d8-1a8d-4a84-acac-3643ec277305", "tag": "5ef2e5a8-9d59-4a28-b6bd-0fa4c569b662"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:04:40.332301 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-dd1e4f62-e56c-4028-aa07-7bfafb8ecdc6 req-d61361fc-42f6-4b1c-987a-221b29e8f1f8 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:40.332750 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-dd1e4f62-e56c-4028-aa07-7bfafb8ecdc6 req-d61361fc-42f6-4b1c-987a-221b29e8f1f8 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:40.342889 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-2c484f5e-53e8-4842-807c-3498575d9896 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:40.345453 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-dd1e4f62-e56c-4028-aa07-7bfafb8ecdc6 req-d61361fc-42f6-4b1c-987a-221b29e8f1f8 service nova] Creating event network-changed:5ef2e5a8-9d59-4a28-b6bd-0fa4c569b662 for instance dc1172d8-1a8d-4a84-acac-3643ec277305 on hv-cinder-82549 May 27 10:04:40.353005 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-dd1e4f62-e56c-4028-aa07-7bfafb8ecdc6 req-d61361fc-42f6-4b1c-987a-221b29e8f1f8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034373 May 27 10:04:40.354597 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 571/1151] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 10:04:40.355074 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-2c484f5e-53e8-4842-807c-3498575d9896 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.214328 May 27 10:04:40.355654 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 581/1152] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:40 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:41.377202 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-9268f357-d6f6-40e0-9253-ca6e346b1ab8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:41.377913 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-9268f357-d6f6-40e0-9253-ca6e346b1ab8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:41.384670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9268f357-d6f6-40e0-9253-ca6e346b1ab8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:41.385120 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9268f357-d6f6-40e0-9253-ca6e346b1ab8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:41.385882 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9268f357-d6f6-40e0-9253-ca6e346b1ab8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:41.386346 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-9268f357-d6f6-40e0-9253-ca6e346b1ab8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:41.514629 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-9268f357-d6f6-40e0-9253-ca6e346b1ab8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:41.522483 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-9268f357-d6f6-40e0-9253-ca6e346b1ab8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.149602 May 27 10:04:41.523045 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 572/1153] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:41 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:42.539550 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-02017c20-424e-4288-98ac-f61acb10bc23 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:42.540148 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-02017c20-424e-4288-98ac-f61acb10bc23 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:42.546853 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-02017c20-424e-4288-98ac-f61acb10bc23 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:42.547298 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-02017c20-424e-4288-98ac-f61acb10bc23 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:42.548053 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-02017c20-424e-4288-98ac-f61acb10bc23 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:42.548487 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-02017c20-424e-4288-98ac-f61acb10bc23 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:42.680062 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-02017c20-424e-4288-98ac-f61acb10bc23 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:42.688675 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-02017c20-424e-4288-98ac-f61acb10bc23 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.152829 May 27 10:04:42.689283 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 582/1154] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:42 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:43.705388 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5f9035b9-cf5c-4556-8bee-5796a059802c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:43.706006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5f9035b9-cf5c-4556-8bee-5796a059802c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:43.712575 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5f9035b9-cf5c-4556-8bee-5796a059802c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:43.715743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5f9035b9-cf5c-4556-8bee-5796a059802c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:43.715743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5f9035b9-cf5c-4556-8bee-5796a059802c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:43.715743 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5f9035b9-cf5c-4556-8bee-5796a059802c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:43.843134 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-5f9035b9-cf5c-4556-8bee-5796a059802c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:43.851181 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5f9035b9-cf5c-4556-8bee-5796a059802c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.149680 May 27 10:04:43.851744 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 573/1155] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:43 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:44.868053 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-3c800492-9d5e-45cb-a1c8-2f914ebc4d2b tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:44.868588 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-3c800492-9d5e-45cb-a1c8-2f914ebc4d2b tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:44.875081 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c800492-9d5e-45cb-a1c8-2f914ebc4d2b tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:44.876036 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c800492-9d5e-45cb-a1c8-2f914ebc4d2b tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:44.876794 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c800492-9d5e-45cb-a1c8-2f914ebc4d2b tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:44.877228 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-3c800492-9d5e-45cb-a1c8-2f914ebc4d2b tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:45.002964 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-3c800492-9d5e-45cb-a1c8-2f914ebc4d2b tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:45.010373 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-3c800492-9d5e-45cb-a1c8-2f914ebc4d2b tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.146304 May 27 10:04:45.010939 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 583/1156] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:44 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:46.027611 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-5efedb5a-e3c9-4dfb-beb7-560d71b49362 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:46.028222 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-5efedb5a-e3c9-4dfb-beb7-560d71b49362 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:46.035273 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5efedb5a-e3c9-4dfb-beb7-560d71b49362 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:46.035721 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5efedb5a-e3c9-4dfb-beb7-560d71b49362 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:46.036477 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5efedb5a-e3c9-4dfb-beb7-560d71b49362 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:46.037176 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-5efedb5a-e3c9-4dfb-beb7-560d71b49362 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:46.165006 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-5efedb5a-e3c9-4dfb-beb7-560d71b49362 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:46.172589 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-5efedb5a-e3c9-4dfb-beb7-560d71b49362 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.148733 May 27 10:04:46.173887 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 574/1157] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:46 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:47.191194 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-4acfe580-5e65-4d4a-b986-93e6a7a12ca9 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:47.191835 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-4acfe580-5e65-4d4a-b986-93e6a7a12ca9 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:47.194120 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:04:47.194808 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=6 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:04:47.199612 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4acfe580-5e65-4d4a-b986-93e6a7a12ca9 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:47.200064 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4acfe580-5e65-4d4a-b986-93e6a7a12ca9 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:47.200818 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4acfe580-5e65-4d4a-b986-93e6a7a12ca9 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:47.201252 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-4acfe580-5e65-4d4a-b986-93e6a7a12ca9 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:47.328866 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-4acfe580-5e65-4d4a-b986-93e6a7a12ca9 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:47.336242 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-4acfe580-5e65-4d4a-b986-93e6a7a12ca9 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.148887 May 27 10:04:47.341667 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 584/1158] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:47 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 10:04:48.353660 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8151f160-785b-4a0d-a109-ca36af781192 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:48.354417 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8151f160-785b-4a0d-a109-ca36af781192 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:48.356345 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:04:48.362085 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8151f160-785b-4a0d-a109-ca36af781192 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:48.362556 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8151f160-785b-4a0d-a109-ca36af781192 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:48.367669 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8151f160-785b-4a0d-a109-ca36af781192 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:48.367669 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8151f160-785b-4a0d-a109-ca36af781192 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:48.494490 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8151f160-785b-4a0d-a109-ca36af781192 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:48.502807 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8151f160-785b-4a0d-a109-ca36af781192 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.152948 May 27 10:04:48.503382 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 575/1159] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:48 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:49.519637 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-dc218f25-84f0-4b32-ad0f-c060bb383024 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:49.520289 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-dc218f25-84f0-4b32-ad0f-c060bb383024 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:49.526800 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dc218f25-84f0-4b32-ad0f-c060bb383024 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:49.527253 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dc218f25-84f0-4b32-ad0f-c060bb383024 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:49.528007 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dc218f25-84f0-4b32-ad0f-c060bb383024 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:49.528441 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-dc218f25-84f0-4b32-ad0f-c060bb383024 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:49.660245 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-dc218f25-84f0-4b32-ad0f-c060bb383024 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:49.667837 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-dc218f25-84f0-4b32-ad0f-c060bb383024 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.152115 May 27 10:04:49.668402 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 585/1160] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:49 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:50.020996 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-94bfc6c6-f74d-444f-b12f-fe5f68426569 req-a64e8e2a-468f-4fba-81d8-a17b8bae7ddd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1172d8-1a8d-4a84-acac-3643ec277305", "name": "network-vif-plugged", "status": "completed", "tag": "5ef2e5a8-9d59-4a28-b6bd-0fa4c569b662"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:04:50.029385 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-94bfc6c6-f74d-444f-b12f-fe5f68426569 req-a64e8e2a-468f-4fba-81d8-a17b8bae7ddd service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:50.029823 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-94bfc6c6-f74d-444f-b12f-fe5f68426569 req-a64e8e2a-468f-4fba-81d8-a17b8bae7ddd service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:50.041355 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-94bfc6c6-f74d-444f-b12f-fe5f68426569 req-a64e8e2a-468f-4fba-81d8-a17b8bae7ddd service nova] Creating event network-vif-plugged:5ef2e5a8-9d59-4a28-b6bd-0fa4c569b662 for instance dc1172d8-1a8d-4a84-acac-3643ec277305 on hv-cinder-82549 May 27 10:04:50.046861 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-94bfc6c6-f74d-444f-b12f-fe5f68426569 req-a64e8e2a-468f-4fba-81d8-a17b8bae7ddd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029567 May 27 10:04:50.047523 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 576/1161] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 10:04:50.142708 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:04:50.142901 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 10:04:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:04:50.684380 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-bdae2865-f1a7-4ab8-9897-ee586dba619c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:50.685002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-bdae2865-f1a7-4ab8-9897-ee586dba619c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:50.691615 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bdae2865-f1a7-4ab8-9897-ee586dba619c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:50.692067 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bdae2865-f1a7-4ab8-9897-ee586dba619c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:50.692831 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bdae2865-f1a7-4ab8-9897-ee586dba619c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:50.693272 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bdae2865-f1a7-4ab8-9897-ee586dba619c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:50.825360 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-bdae2865-f1a7-4ab8-9897-ee586dba619c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:50.833291 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-bdae2865-f1a7-4ab8-9897-ee586dba619c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.152775 May 27 10:04:50.833852 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 586/1162] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:50 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:51.851861 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0a822a52-7cf8-488f-ba5f-5eb7b9a9955c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:51.852463 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0a822a52-7cf8-488f-ba5f-5eb7b9a9955c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:51.859412 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a822a52-7cf8-488f-ba5f-5eb7b9a9955c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:51.860524 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a822a52-7cf8-488f-ba5f-5eb7b9a9955c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:51.861290 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a822a52-7cf8-488f-ba5f-5eb7b9a9955c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:51.861727 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a822a52-7cf8-488f-ba5f-5eb7b9a9955c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:51.989541 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-0a822a52-7cf8-488f-ba5f-5eb7b9a9955c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:51.997013 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0a822a52-7cf8-488f-ba5f-5eb7b9a9955c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1265 microversion: 2.1 time: 0.149998 May 27 10:04:51.999536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 577/1163] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:51 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:53.014058 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-80daa008-b4ca-4efc-b2f8-191d59e05658 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:53.014700 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-80daa008-b4ca-4efc-b2f8-191d59e05658 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:53.021421 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-80daa008-b4ca-4efc-b2f8-191d59e05658 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:53.021860 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-80daa008-b4ca-4efc-b2f8-191d59e05658 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:53.022659 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-80daa008-b4ca-4efc-b2f8-191d59e05658 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:53.023091 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-80daa008-b4ca-4efc-b2f8-191d59e05658 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:53.149019 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-80daa008-b4ca-4efc-b2f8-191d59e05658 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:53.156405 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-80daa008-b4ca-4efc-b2f8-191d59e05658 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1451 microversion: 2.1 time: 0.146239 May 27 10:04:53.157471 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 587/1164] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:53 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:53.174128 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-319a2ac5-fc15-4972-acfc-fbc8251ebeb7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:04:53.174777 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-319a2ac5-fc15-4972-acfc-fbc8251ebeb7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:04:53.181239 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-319a2ac5-fc15-4972-acfc-fbc8251ebeb7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:53.181696 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-319a2ac5-fc15-4972-acfc-fbc8251ebeb7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:53.182493 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-319a2ac5-fc15-4972-acfc-fbc8251ebeb7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:53.182940 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-319a2ac5-fc15-4972-acfc-fbc8251ebeb7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:53.315162 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-319a2ac5-fc15-4972-acfc-fbc8251ebeb7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:04:53.322694 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-319a2ac5-fc15-4972-acfc-fbc8251ebeb7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1451 microversion: 2.1 time: 0.152958 May 27 10:04:53.323253 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 578/1165] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:04:53 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:04:55.524202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-75a74881-d411-4b20-9f78-a6bc829a69aa req-06a37264-d3cb-466d-8612-7fcac90145dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1172d8-1a8d-4a84-acac-3643ec277305", "tag": "5ef2e5a8-9d59-4a28-b6bd-0fa4c569b662"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:04:55.532707 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-75a74881-d411-4b20-9f78-a6bc829a69aa req-06a37264-d3cb-466d-8612-7fcac90145dd service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:04:55.533147 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-75a74881-d411-4b20-9f78-a6bc829a69aa req-06a37264-d3cb-466d-8612-7fcac90145dd service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:04:55.545168 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-75a74881-d411-4b20-9f78-a6bc829a69aa req-06a37264-d3cb-466d-8612-7fcac90145dd service nova] Creating event network-changed:5ef2e5a8-9d59-4a28-b6bd-0fa4c569b662 for instance dc1172d8-1a8d-4a84-acac-3643ec277305 on hv-cinder-82549 May 27 10:04:55.550558 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-75a74881-d411-4b20-9f78-a6bc829a69aa req-06a37264-d3cb-466d-8612-7fcac90145dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029973 May 27 10:04:55.556177 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 588/1166] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:06:34.953500 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:06:34.954248 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 10:06:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:06:35.097155 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:06:35.098013 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 10:06:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:06:43.665134 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:06:43.665804 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 10:06:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:06:59.752829 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:06:59.753569 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:06:59.757485 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1725584707", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-429678364", "security_groups": [{"name": "tempest-secgroup-smoke-1263524947"}], "block_device_mapping_v2": [{"uuid": "3468a533-b480-40e2-aacd-c37a52b33fd8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "43507242-c736-4ecc-9d32-b672049951e6"}]}} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:06:59.921208 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.network.neutron [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] validate_networks() for [('43507242-c736-4ecc-9d32-b672049951e6', None, None, None, None, None)] {{(pid=124828) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 27 10:07:00.334609 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Flavor limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 27 10:07:00.335094 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Image limits 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 27 10:07:00.335501 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Flavor pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 27 10:07:00.335908 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Image pref 0:0:0 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 27 10:07:00.336323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.virt.hardware [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124828) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 27 10:07:00.345302 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:00.345749 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:00.347187 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:00.347627 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:00.365844 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Getting quotas for project fb894beeec434e34b0a8224128eda0c1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 27 10:07:00.368378 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.quota [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Getting quotas for user ce5ba392d54f4d9588b7e3f891e8e331 and project fb894beeec434e34b0a8224128eda0c1. Resources: {'cores', 'ram', 'instances'} {{(pid=124828) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 27 10:07:00.430834 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Going to run 1 instances... {{(pid=124828) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 27 10:07:00.432921 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3468a533-b480-40e2-aacd-c37a52b33fd8',volume_size=None,volume_type=None)] {{(pid=124828) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 27 10:07:01.047336 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-0a658f78-e3ac-4700-8fe4-dc7ed227810c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.296746 May 27 10:07:01.048290 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 579/1167] 10.222.0.48 () {60 vars in 1146 bytes} [Fri May 27 10:06:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 27 10:07:01.056929 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:07:01.063047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=72 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:07:01.063047 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9d3e00c7-b5f3-479b-888e-c514d8c63e9c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:01.063529 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9d3e00c7-b5f3-479b-888e-c514d8c63e9c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:01.149016 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-9d3e00c7-b5f3-479b-888e-c514d8c63e9c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:01.151101 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9d3e00c7-b5f3-479b-888e-c514d8c63e9c tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1094 microversion: 2.1 time: 0.096364 May 27 10:07:01.151712 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 589/1168] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:01 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1094 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:02.170011 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-7b47b28e-3a94-49e0-926f-a18cdf4e0021 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:02.170705 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-7b47b28e-3a94-49e0-926f-a18cdf4e0021 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:02.223370 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-7b47b28e-3a94-49e0-926f-a18cdf4e0021 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:02.230637 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-7b47b28e-3a94-49e0-926f-a18cdf4e0021 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1094 microversion: 2.1 time: 0.065033 May 27 10:07:02.231204 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 580/1169] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:02 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:03.254634 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-618bfe72-31f8-4e13-b607-f9222cecabb8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:03.255648 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-618bfe72-31f8-4e13-b607-f9222cecabb8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:03.265611 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-618bfe72-31f8-4e13-b607-f9222cecabb8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:03.266181 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-618bfe72-31f8-4e13-b607-f9222cecabb8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:03.267194 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-618bfe72-31f8-4e13-b607-f9222cecabb8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:03.267787 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-618bfe72-31f8-4e13-b607-f9222cecabb8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:03.342645 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-618bfe72-31f8-4e13-b607-f9222cecabb8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:03.352614 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-618bfe72-31f8-4e13-b607-f9222cecabb8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1192 microversion: 2.1 time: 0.103326 May 27 10:07:03.353360 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 590/1170] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:03 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1192 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:04.377386 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2bf18cfb-0880-42c9-a22e-72fe7c2a69cb tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:04.379383 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2bf18cfb-0880-42c9-a22e-72fe7c2a69cb tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:04.389752 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bf18cfb-0880-42c9-a22e-72fe7c2a69cb tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:04.390594 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bf18cfb-0880-42c9-a22e-72fe7c2a69cb tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:04.391713 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bf18cfb-0880-42c9-a22e-72fe7c2a69cb tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:04.392511 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2bf18cfb-0880-42c9-a22e-72fe7c2a69cb tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:04.560437 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2bf18cfb-0880-42c9-a22e-72fe7c2a69cb tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:04.575018 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2bf18cfb-0880-42c9-a22e-72fe7c2a69cb tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1278 microversion: 2.1 time: 0.201630 May 27 10:07:04.576410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 581/1171] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:04 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:05.431468 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-834334bf-b73a-4b10-ad6b-aed24e387b15 req-70d68ea0-17c4-4dd8-b0e4-b541e05e6206 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ba6ff3-6539-4f70-a362-7c0fc40f6350", "tag": "f321d8e7-b2c7-4fff-8c21-58493c31ef10"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:07:05.440180 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-834334bf-b73a-4b10-ad6b-aed24e387b15 req-70d68ea0-17c4-4dd8-b0e4-b541e05e6206 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:05.440653 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-834334bf-b73a-4b10-ad6b-aed24e387b15 req-70d68ea0-17c4-4dd8-b0e4-b541e05e6206 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:05.452801 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-834334bf-b73a-4b10-ad6b-aed24e387b15 req-70d68ea0-17c4-4dd8-b0e4-b541e05e6206 service nova] Creating event network-changed:f321d8e7-b2c7-4fff-8c21-58493c31ef10 for instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 on hv-cinder-82549 May 27 10:07:05.458249 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-834334bf-b73a-4b10-ad6b-aed24e387b15 req-70d68ea0-17c4-4dd8-b0e4-b541e05e6206 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104044 May 27 10:07:05.458855 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 591/1172] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:07:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:07:05.594185 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-32d678b4-22e7-4a05-871e-903a3d1c0a2e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:05.602626 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-32d678b4-22e7-4a05-871e-903a3d1c0a2e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:05.602626 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32d678b4-22e7-4a05-871e-903a3d1c0a2e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:05.602626 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32d678b4-22e7-4a05-871e-903a3d1c0a2e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:05.603049 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32d678b4-22e7-4a05-871e-903a3d1c0a2e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:05.604134 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-32d678b4-22e7-4a05-871e-903a3d1c0a2e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:05.760877 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-32d678b4-22e7-4a05-871e-903a3d1c0a2e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:05.773670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-32d678b4-22e7-4a05-871e-903a3d1c0a2e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.183702 May 27 10:07:05.775075 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 582/1173] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:05 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 10:07:06.793585 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-df498ca2-76e4-4d6b-87cc-7a3d188c2453 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:06.794324 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-df498ca2-76e4-4d6b-87cc-7a3d188c2453 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:06.800638 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-df498ca2-76e4-4d6b-87cc-7a3d188c2453 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:06.801594 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-df498ca2-76e4-4d6b-87cc-7a3d188c2453 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:06.802477 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-df498ca2-76e4-4d6b-87cc-7a3d188c2453 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:06.802910 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-df498ca2-76e4-4d6b-87cc-7a3d188c2453 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:06.952996 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-df498ca2-76e4-4d6b-87cc-7a3d188c2453 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:06.961252 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-df498ca2-76e4-4d6b-87cc-7a3d188c2453 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.172313 May 27 10:07:06.961797 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 592/1174] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:06 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:07.980493 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8c1225b8-0602-438d-9bd1-bd0f24a97419 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:07.981067 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8c1225b8-0602-438d-9bd1-bd0f24a97419 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:07.987678 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8c1225b8-0602-438d-9bd1-bd0f24a97419 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:07.988129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8c1225b8-0602-438d-9bd1-bd0f24a97419 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:07.989553 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8c1225b8-0602-438d-9bd1-bd0f24a97419 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:07.989989 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8c1225b8-0602-438d-9bd1-bd0f24a97419 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:08.124534 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8c1225b8-0602-438d-9bd1-bd0f24a97419 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:08.132645 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8c1225b8-0602-438d-9bd1-bd0f24a97419 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.156804 May 27 10:07:08.133208 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 583/1175] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:07 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:09.149987 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-bb272c00-bbd5-4319-b139-59d093705f61 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:09.150572 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-bb272c00-bbd5-4319-b139-59d093705f61 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:09.157092 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bb272c00-bbd5-4319-b139-59d093705f61 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:09.157539 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bb272c00-bbd5-4319-b139-59d093705f61 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:09.158330 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bb272c00-bbd5-4319-b139-59d093705f61 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:09.158771 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-bb272c00-bbd5-4319-b139-59d093705f61 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:09.294825 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-bb272c00-bbd5-4319-b139-59d093705f61 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:09.303885 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-bb272c00-bbd5-4319-b139-59d093705f61 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.157753 May 27 10:07:09.304521 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 593/1176] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:09 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:10.321650 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-b48ff729-b810-476a-b687-96f3fbca89a7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:10.322304 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-b48ff729-b810-476a-b687-96f3fbca89a7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:10.329428 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b48ff729-b810-476a-b687-96f3fbca89a7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:10.329878 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b48ff729-b810-476a-b687-96f3fbca89a7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:10.330702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b48ff729-b810-476a-b687-96f3fbca89a7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:10.331133 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-b48ff729-b810-476a-b687-96f3fbca89a7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:10.356258 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=2 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:07:10.469132 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-b48ff729-b810-476a-b687-96f3fbca89a7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:10.476768 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-b48ff729-b810-476a-b687-96f3fbca89a7 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.159078 May 27 10:07:10.477338 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 584/1177] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:10 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:11.494866 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-86aceb93-d088-451b-9a36-682844493578 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:11.495481 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-86aceb93-d088-451b-9a36-682844493578 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:11.497941 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell0:SELECT=2 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:07:11.508952 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-86aceb93-d088-451b-9a36-682844493578 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:11.509773 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-86aceb93-d088-451b-9a36-682844493578 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:11.511602 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-86aceb93-d088-451b-9a36-682844493578 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:11.512066 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-86aceb93-d088-451b-9a36-682844493578 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:11.646637 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-86aceb93-d088-451b-9a36-682844493578 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:11.654497 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-86aceb93-d088-451b-9a36-682844493578 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.163895 May 27 10:07:11.655063 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 594/1178] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:11 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:12.671369 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-bc6f7d0b-306c-45c0-80dd-b94d15092b43 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:12.671975 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-bc6f7d0b-306c-45c0-80dd-b94d15092b43 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:12.674323 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell0:SELECT=8 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:07:12.679219 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bc6f7d0b-306c-45c0-80dd-b94d15092b43 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:12.679814 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bc6f7d0b-306c-45c0-80dd-b94d15092b43 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:12.680412 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bc6f7d0b-306c-45c0-80dd-b94d15092b43 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:12.680851 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-bc6f7d0b-306c-45c0-80dd-b94d15092b43 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:12.833611 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-bc6f7d0b-306c-45c0-80dd-b94d15092b43 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:12.841751 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-bc6f7d0b-306c-45c0-80dd-b94d15092b43 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.174158 May 27 10:07:12.842358 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 585/1179] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:12 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 10:07:13.861858 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e1f17b78-53a6-4e09-8558-a91fa26f062a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:13.862434 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e1f17b78-53a6-4e09-8558-a91fa26f062a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:13.869696 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e1f17b78-53a6-4e09-8558-a91fa26f062a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:13.873345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e1f17b78-53a6-4e09-8558-a91fa26f062a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:13.873345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e1f17b78-53a6-4e09-8558-a91fa26f062a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:13.873345 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e1f17b78-53a6-4e09-8558-a91fa26f062a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:14.011059 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e1f17b78-53a6-4e09-8558-a91fa26f062a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:14.019078 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e1f17b78-53a6-4e09-8558-a91fa26f062a tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.161175 May 27 10:07:14.020185 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 595/1180] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:13 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:15.037452 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-aab0e780-32f5-4b62-9fce-30fcecd05da4 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:15.038144 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-aab0e780-32f5-4b62-9fce-30fcecd05da4 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:15.048268 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aab0e780-32f5-4b62-9fce-30fcecd05da4 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:15.048733 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aab0e780-32f5-4b62-9fce-30fcecd05da4 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:15.049528 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aab0e780-32f5-4b62-9fce-30fcecd05da4 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:15.049970 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-aab0e780-32f5-4b62-9fce-30fcecd05da4 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:15.191251 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-aab0e780-32f5-4b62-9fce-30fcecd05da4 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:15.201776 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-aab0e780-32f5-4b62-9fce-30fcecd05da4 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.168394 May 27 10:07:15.202444 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 586/1181] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:15 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:16.220286 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-31115341-380e-4961-a1ec-fe24fb7208c8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:16.220998 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-31115341-380e-4961-a1ec-fe24fb7208c8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:16.228588 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-31115341-380e-4961-a1ec-fe24fb7208c8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:16.229428 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-31115341-380e-4961-a1ec-fe24fb7208c8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:16.230241 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-31115341-380e-4961-a1ec-fe24fb7208c8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:16.230681 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-31115341-380e-4961-a1ec-fe24fb7208c8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:16.383456 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-31115341-380e-4961-a1ec-fe24fb7208c8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:16.394214 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-31115341-380e-4961-a1ec-fe24fb7208c8 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.177902 May 27 10:07:16.395011 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 596/1182] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:16 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:16.916824 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-3d101f69-aee5-44e7-98f4-7d6a99a68a2b req-8130ba19-4145-4385-9369-40d01e7c1adb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ba6ff3-6539-4f70-a362-7c0fc40f6350", "name": "network-vif-plugged", "status": "completed", "tag": "f321d8e7-b2c7-4fff-8c21-58493c31ef10"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:07:16.927976 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-3d101f69-aee5-44e7-98f4-7d6a99a68a2b req-8130ba19-4145-4385-9369-40d01e7c1adb service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:16.927976 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-3d101f69-aee5-44e7-98f4-7d6a99a68a2b req-8130ba19-4145-4385-9369-40d01e7c1adb service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:16.942539 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-3d101f69-aee5-44e7-98f4-7d6a99a68a2b req-8130ba19-4145-4385-9369-40d01e7c1adb service nova] Creating event network-vif-plugged:f321d8e7-b2c7-4fff-8c21-58493c31ef10 for instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 on hv-cinder-82549 May 27 10:07:16.948838 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-3d101f69-aee5-44e7-98f4-7d6a99a68a2b req-8130ba19-4145-4385-9369-40d01e7c1adb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093101 May 27 10:07:16.953129 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 587/1183] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:07:17.413777 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-e193991d-d8f0-4190-a0b5-69183f726a36 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:17.414492 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-e193991d-d8f0-4190-a0b5-69183f726a36 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:17.421013 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e193991d-d8f0-4190-a0b5-69183f726a36 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:17.421464 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e193991d-d8f0-4190-a0b5-69183f726a36 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:17.422248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e193991d-d8f0-4190-a0b5-69183f726a36 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:17.422690 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-e193991d-d8f0-4190-a0b5-69183f726a36 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:17.577755 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-e193991d-d8f0-4190-a0b5-69183f726a36 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:17.588378 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-e193991d-d8f0-4190-a0b5-69183f726a36 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.178764 May 27 10:07:17.589074 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 597/1184] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:17 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 10:07:18.606898 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-364ce0e1-2a63-4d66-8ba1-880275e8663e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:18.607604 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-364ce0e1-2a63-4d66-8ba1-880275e8663e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:18.614044 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-364ce0e1-2a63-4d66-8ba1-880275e8663e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:18.614531 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-364ce0e1-2a63-4d66-8ba1-880275e8663e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:18.615305 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-364ce0e1-2a63-4d66-8ba1-880275e8663e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:18.615736 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-364ce0e1-2a63-4d66-8ba1-880275e8663e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:18.763410 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-364ce0e1-2a63-4d66-8ba1-880275e8663e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:18.773618 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-364ce0e1-2a63-4d66-8ba1-880275e8663e tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1266 microversion: 2.1 time: 0.171441 May 27 10:07:18.774448 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 588/1185] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:18 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:19.794737 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-b15f55a0-1527-4f57-b3f9-3be73b9a85a1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:19.795370 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-b15f55a0-1527-4f57-b3f9-3be73b9a85a1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:19.802718 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b15f55a0-1527-4f57-b3f9-3be73b9a85a1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:19.803166 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b15f55a0-1527-4f57-b3f9-3be73b9a85a1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:19.803944 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b15f55a0-1527-4f57-b3f9-3be73b9a85a1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:19.804380 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-b15f55a0-1527-4f57-b3f9-3be73b9a85a1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:19.941619 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-b15f55a0-1527-4f57-b3f9-3be73b9a85a1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:19.947646 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-b15f55a0-1527-4f57-b3f9-3be73b9a85a1 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1452 microversion: 2.1 time: 0.156744 May 27 10:07:19.948222 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 598/1186] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:19 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:07:19.964277 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-2f7fe163-363a-4063-9f90-40e2421cfc8d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:07:19.964924 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-2f7fe163-363a-4063-9f90-40e2421cfc8d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:07:19.971461 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2f7fe163-363a-4063-9f90-40e2421cfc8d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:19.971907 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2f7fe163-363a-4063-9f90-40e2421cfc8d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:19.972675 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2f7fe163-363a-4063-9f90-40e2421cfc8d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:19.973115 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-2f7fe163-363a-4063-9f90-40e2421cfc8d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:20.105486 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-2f7fe163-363a-4063-9f90-40e2421cfc8d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:07:20.113529 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-2f7fe163-363a-4063-9f90-40e2421cfc8d tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1452 microversion: 2.1 time: 0.153082 May 27 10:07:20.114664 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 589/1187] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:07:19 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 10:07:22.274664 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-3cb2367c-90f3-4061-9ab6-a063070fb719 req-64cd4e65-25b0-4bbe-a4fb-3bdad43abee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ba6ff3-6539-4f70-a362-7c0fc40f6350", "tag": "f321d8e7-b2c7-4fff-8c21-58493c31ef10"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:07:22.283028 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-3cb2367c-90f3-4061-9ab6-a063070fb719 req-64cd4e65-25b0-4bbe-a4fb-3bdad43abee7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:07:22.283474 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-3cb2367c-90f3-4061-9ab6-a063070fb719 req-64cd4e65-25b0-4bbe-a4fb-3bdad43abee7 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:07:22.296424 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-3cb2367c-90f3-4061-9ab6-a063070fb719 req-64cd4e65-25b0-4bbe-a4fb-3bdad43abee7 service nova] Creating event network-changed:f321d8e7-b2c7-4fff-8c21-58493c31ef10 for instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 on hv-cinder-82549 May 27 10:07:22.303388 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-3cb2367c-90f3-4061-9ab6-a063070fb719 req-64cd4e65-25b0-4bbe-a4fb-3bdad43abee7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104312 May 27 10:07:22.304499 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 599/1188] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:09:12.131003 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3e5c283-68fe-44cc-b801-9d393f524392] AMQP server on 10.222.0.48:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 27 10:09:12.131560 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:09:12.133300 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b291220a-e50b-4a38-a0f0-e73535eef307] AMQP server on 10.222.0.48:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 27 10:09:12.133895 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_api:SELECT=24 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:09:12.134027 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG dbcounter [-] [124828] Writing DB stats nova_cell1:SELECT=52 {{(pid=124828) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:09:12.134676 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG dbcounter [-] [124829] Writing DB stats nova_cell1:SELECT=52 {{(pid=124829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 27 10:09:12.138282 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-59352eb1-92b7-45f1-a27d-8cfab583a040 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:12.138781 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-59352eb1-92b7-45f1-a27d-8cfab583a040 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:12.139103 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-7139dfcf-e42e-44f8-a59e-5376d1553375 req-2fbbda06-e461-4ec5-8500-a6f2b3ac77bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ba6ff3-6539-4f70-a362-7c0fc40f6350", "tag": "f321d8e7-b2c7-4fff-8c21-58493c31ef10"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:09:12.145399 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-59352eb1-92b7-45f1-a27d-8cfab583a040 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:12.145842 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-59352eb1-92b7-45f1-a27d-8cfab583a040 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:12.146641 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-59352eb1-92b7-45f1-a27d-8cfab583a040 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:12.147071 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-59352eb1-92b7-45f1-a27d-8cfab583a040 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:12.149311 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-7139dfcf-e42e-44f8-a59e-5376d1553375 req-2fbbda06-e461-4ec5-8500-a6f2b3ac77bc service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:12.150002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-7139dfcf-e42e-44f8-a59e-5376d1553375 req-2fbbda06-e461-4ec5-8500-a6f2b3ac77bc service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:12.163055 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-7139dfcf-e42e-44f8-a59e-5376d1553375 req-2fbbda06-e461-4ec5-8500-a6f2b3ac77bc service nova] Creating event network-changed:f321d8e7-b2c7-4fff-8c21-58493c31ef10 for instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 on hv-cinder-82549 May 27 10:09:12.168984 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-7139dfcf-e42e-44f8-a59e-5376d1553375 req-2fbbda06-e461-4ec5-8500-a6f2b3ac77bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037277 May 27 10:09:12.169822 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 600/1189] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:09:12.179092 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-59352eb1-92b7-45f1-a27d-8cfab583a040 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Going to try to terminate instance {{(pid=124828) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 10:09:12.481179 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-59352eb1-92b7-45f1-a27d-8cfab583a040 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 204 len: 0 microversion: 2.1 time: 0.352376 May 27 10:09:12.481896 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 590/1190] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 10:09:12 2022] DELETE /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 10:09:12.497246 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-8db2c7cc-8186-4fb4-86e0-2ba4601fdb09 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:12.497962 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-8db2c7cc-8186-4fb4-86e0-2ba4601fdb09 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:12.507000 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8db2c7cc-8186-4fb4-86e0-2ba4601fdb09 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:12.507448 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8db2c7cc-8186-4fb4-86e0-2ba4601fdb09 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:12.508783 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8db2c7cc-8186-4fb4-86e0-2ba4601fdb09 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:12.509229 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-8db2c7cc-8186-4fb4-86e0-2ba4601fdb09 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:12.689407 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-8db2c7cc-8186-4fb4-86e0-2ba4601fdb09 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:09:12.699248 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-8db2c7cc-8186-4fb4-86e0-2ba4601fdb09 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1577 microversion: 2.1 time: 0.206763 May 27 10:09:12.699784 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 601/1191] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:09:12 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 27 10:09:13.718716 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-e37122b5-6024-4b3f-8955-f84ccb019607 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:13.719434 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-e37122b5-6024-4b3f-8955-f84ccb019607 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:13.729523 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e37122b5-6024-4b3f-8955-f84ccb019607 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:13.729983 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e37122b5-6024-4b3f-8955-f84ccb019607 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:13.731103 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e37122b5-6024-4b3f-8955-f84ccb019607 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:13.731821 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-e37122b5-6024-4b3f-8955-f84ccb019607 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:13.739823 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3e5c283-68fe-44cc-b801-9d393f524392] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55680. May 27 10:09:13.876409 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-e37122b5-6024-4b3f-8955-f84ccb019607 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:09:13.884536 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-e37122b5-6024-4b3f-8955-f84ccb019607 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1458 microversion: 2.1 time: 0.170415 May 27 10:09:13.885100 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 591/1192] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:09:13 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1458 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:09:14.748945 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [req-e3e2e000-aed3-4cf1-b11a-ec27afeddc1c req-7b661363-8ed7-4ebe-9536-9418cb141d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ba6ff3-6539-4f70-a362-7c0fc40f6350", "name": "network-vif-deleted", "tag": "f321d8e7-b2c7-4fff-8c21-58493c31ef10"}]} {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:09:14.760742 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-e3e2e000-aed3-4cf1-b11a-ec27afeddc1c req-7b661363-8ed7-4ebe-9536-9418cb141d78 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:14.765202 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [req-e3e2e000-aed3-4cf1-b11a-ec27afeddc1c req-7b661363-8ed7-4ebe-9536-9418cb141d78 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:14.767167 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] [b291220a-e50b-4a38-a0f0-e73535eef307] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 55684. May 27 10:09:14.775647 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.compute.server_external_events [req-e3e2e000-aed3-4cf1-b11a-ec27afeddc1c req-7b661363-8ed7-4ebe-9536-9418cb141d78 service nova] Creating event network-vif-deleted:f321d8e7-b2c7-4fff-8c21-58493c31ef10 for instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 on hv-cinder-82549 May 27 10:09:14.781009 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [req-e3e2e000-aed3-4cf1-b11a-ec27afeddc1c req-7b661363-8ed7-4ebe-9536-9418cb141d78 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036386 May 27 10:09:14.781628 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 602/1193] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:09:14.903095 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-8e5309cd-e0a9-4704-8f61-dabb607409c0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:14.903671 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-8e5309cd-e0a9-4704-8f61-dabb607409c0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:14.910702 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8e5309cd-e0a9-4704-8f61-dabb607409c0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:14.911151 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8e5309cd-e0a9-4704-8f61-dabb607409c0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:14.911919 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8e5309cd-e0a9-4704-8f61-dabb607409c0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:14.912493 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-8e5309cd-e0a9-4704-8f61-dabb607409c0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:14.983668 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-8e5309cd-e0a9-4704-8f61-dabb607409c0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:09:14.991972 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-8e5309cd-e0a9-4704-8f61-dabb607409c0 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1225 microversion: 2.1 time: 0.092845 May 27 10:09:14.992634 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 592/1194] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:09:14 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:09:16.011400 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:16.015635 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:16.021591 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:16.022336 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:16.023564 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:16.024288 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:16.062158 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:16.062971 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:16.063425 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.objects.instance [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lazy-loading 'fault' on Instance uuid e0ba6ff3-6539-4f70-a362-7c0fc40f6350 {{(pid=124829) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 27 10:09:16.107261 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:09:16.115061 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-400cfb57-2249-4cd1-aa3d-4142c79aabf3 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 200 len: 1230 microversion: 2.1 time: 0.108621 May 27 10:09:16.120092 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 603/1195] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:09:16 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 1230 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:09:17.133372 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1cc4eba9-9f63-4e16-95d4-80344f879026 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:17.133974 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-1cc4eba9-9f63-4e16-95d4-80344f879026 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: e0ba6ff3-6539-4f70-a362-7c0fc40f6350] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:17.140810 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1cc4eba9-9f63-4e16-95d4-80344f879026 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:17.141257 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1cc4eba9-9f63-4e16-95d4-80344f879026 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:17.142020 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1cc4eba9-9f63-4e16-95d4-80344f879026 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:17.142479 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-1cc4eba9-9f63-4e16-95d4-80344f879026 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:17.156581 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-1cc4eba9-9f63-4e16-95d4-80344f879026 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] HTTP exception thrown: Instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 could not be found. May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1cc4eba9-9f63-4e16-95d4-80344f879026 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Request method failure captured: May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 HTTP/1.1 May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikKF1fFhRZe7yxXme7VVQkO_-55UXOBGijikvi4V_os1FR_QpSugoOdaBa3EsXQTDbfvvzWNOU1n4GIZCZlxWOnOt8ikJnie45FB5frkizKACCLFhZx3kmO4ozAGY8BHVml_L__KwyMImIUrUlI6AKS1wAVysiLbbDDRiWNvTI4iCyrM May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: fb894beeec434e34b0a8224128eda0c1 May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 10:09:17.158572 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fb894beeec434e34b0a8224128eda0c1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: fb894beeec434e34b0a8224128eda0c1 May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-TestVolumeBootPattern-1126995217-project May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: ce5ba392d54f4d9588b7e3f891e8e331 May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-TestVolumeBootPattern-1126995217-project May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 could not be found. May 27 10:09:17.160306 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': 'e0ba6ff3-6539-4f70-a362-7c0fc40f6350'} May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 could not be found. May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 10:09:17.161272 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 could not be found. May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 could not be found. May 27 10:09:17.162929 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:17.164255 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-1cc4eba9-9f63-4e16-95d4-80344f879026 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Returning 404 to user: Instance e0ba6ff3-6539-4f70-a362-7c0fc40f6350 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 10:09:17.164255 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-1cc4eba9-9f63-4e16-95d4-80344f879026 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350" status: 404 len: 111 microversion: 2.1 time: 0.030623 May 27 10:09:17.164255 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 593/1196] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:09:17 2022] GET /compute/v2.1/servers/e0ba6ff3-6539-4f70-a362-7c0fc40f6350 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 10:09:20.590589 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-9dde2ee9-820c-4815-affd-257b9d5fb2dc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:20.591134 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9dde2ee9-820c-4815-affd-257b9d5fb2dc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:20.597620 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9dde2ee9-820c-4815-affd-257b9d5fb2dc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:20.597830 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-e705317c-f3bd-4a12-be22-7746d857fe6f req-15a8de84-b554-4208-b84c-1b04d14d5d75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc1172d8-1a8d-4a84-acac-3643ec277305", "tag": "5ef2e5a8-9d59-4a28-b6bd-0fa4c569b662"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:09:20.598813 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9dde2ee9-820c-4815-affd-257b9d5fb2dc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:20.599595 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9dde2ee9-820c-4815-affd-257b9d5fb2dc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:20.600039 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-9dde2ee9-820c-4815-affd-257b9d5fb2dc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:20.607450 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-e705317c-f3bd-4a12-be22-7746d857fe6f req-15a8de84-b554-4208-b84c-1b04d14d5d75 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:20.608356 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-e705317c-f3bd-4a12-be22-7746d857fe6f req-15a8de84-b554-4208-b84c-1b04d14d5d75 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:20.620488 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-e705317c-f3bd-4a12-be22-7746d857fe6f req-15a8de84-b554-4208-b84c-1b04d14d5d75 service nova] Creating event network-changed:5ef2e5a8-9d59-4a28-b6bd-0fa4c569b662 for instance dc1172d8-1a8d-4a84-acac-3643ec277305 on hv-cinder-82549 May 27 10:09:20.626469 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-e705317c-f3bd-4a12-be22-7746d857fe6f req-15a8de84-b554-4208-b84c-1b04d14d5d75 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037298 May 27 10:09:20.626766 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-9dde2ee9-820c-4815-affd-257b9d5fb2dc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Going to try to terminate instance {{(pid=124829) delete /opt/stack/nova/nova/compute/api.py:2664}} May 27 10:09:20.627392 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 594/1197] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 27 10:09:20.954609 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-9dde2ee9-820c-4815-affd-257b9d5fb2dc tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 204 len: 0 microversion: 2.1 time: 0.368361 May 27 10:09:20.955546 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 604/1198] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 10:09:20 2022] DELETE /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 27 10:09:20.964482 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-917f25cf-5798-43dc-95ef-999f8534a484 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:20.965496 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-917f25cf-5798-43dc-95ef-999f8534a484 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:20.972783 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-917f25cf-5798-43dc-95ef-999f8534a484 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:20.973688 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-917f25cf-5798-43dc-95ef-999f8534a484 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:20.974759 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-917f25cf-5798-43dc-95ef-999f8534a484 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:20.975380 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-917f25cf-5798-43dc-95ef-999f8534a484 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:21.122366 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.policy [None req-917f25cf-5798-43dc-95ef-999f8534a484 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124828) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:09:21.130674 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-917f25cf-5798-43dc-95ef-999f8534a484 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1576 microversion: 2.1 time: 0.170696 May 27 10:09:21.131255 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 595/1199] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:09:20 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:09:22.150285 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-258e17be-4c39-4ffe-9b7c-c6d8904399ce tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:22.151002 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-258e17be-4c39-4ffe-9b7c-c6d8904399ce tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:22.158367 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-258e17be-4c39-4ffe-9b7c-c6d8904399ce tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:22.163044 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-258e17be-4c39-4ffe-9b7c-c6d8904399ce tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:22.163044 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-258e17be-4c39-4ffe-9b7c-c6d8904399ce tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:22.163044 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-258e17be-4c39-4ffe-9b7c-c6d8904399ce tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:22.307458 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-258e17be-4c39-4ffe-9b7c-c6d8904399ce tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:09:22.315347 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-258e17be-4c39-4ffe-9b7c-c6d8904399ce tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1576 microversion: 2.1 time: 0.169774 May 27 10:09:22.315932 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 605/1200] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:09:22 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:09:23.158999 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [req-5c7af72a-b4d4-4eca-8d65-ec0949311619 req-21b4e73c-e87c-4249-a1c4-0a77aee8f0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc1172d8-1a8d-4a84-acac-3643ec277305", "name": "network-vif-deleted", "tag": "5ef2e5a8-9d59-4a28-b6bd-0fa4c569b662"}]} {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 27 10:09:23.167852 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-5c7af72a-b4d4-4eca-8d65-ec0949311619 req-21b4e73c-e87c-4249-a1c4-0a77aee8f0b2 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:23.168385 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [req-5c7af72a-b4d4-4eca-8d65-ec0949311619 req-21b4e73c-e87c-4249-a1c4-0a77aee8f0b2 service nova] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:23.180747 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.compute.server_external_events [req-5c7af72a-b4d4-4eca-8d65-ec0949311619 req-21b4e73c-e87c-4249-a1c4-0a77aee8f0b2 service nova] Creating event network-vif-deleted:5ef2e5a8-9d59-4a28-b6bd-0fa4c569b662 for instance dc1172d8-1a8d-4a84-acac-3643ec277305 on hv-cinder-82549 May 27 10:09:23.186722 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [req-5c7af72a-b4d4-4eca-8d65-ec0949311619 req-21b4e73c-e87c-4249-a1c4-0a77aee8f0b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031365 May 27 10:09:23.187392 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 596/1201] 10.222.0.48 () {64 vars in 1317 bytes} [Fri May 27 10:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 27 10:09:23.334947 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5167f12d-6e23-4d6b-aed4-05273573b374 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:23.335962 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-5167f12d-6e23-4d6b-aed4-05273573b374 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:23.344476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5167f12d-6e23-4d6b-aed4-05273573b374 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:23.344476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5167f12d-6e23-4d6b-aed4-05273573b374 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:23.344476 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5167f12d-6e23-4d6b-aed4-05273573b374 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:23.344957 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-5167f12d-6e23-4d6b-aed4-05273573b374 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:23.411949 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.policy [None req-5167f12d-6e23-4d6b-aed4-05273573b374 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ce5ba392d54f4d9588b7e3f891e8e331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb894beeec434e34b0a8224128eda0c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124829) authorize /opt/stack/nova/nova/policy.py:199}} May 27 10:09:23.419867 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5167f12d-6e23-4d6b-aed4-05273573b374 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 200 len: 1224 microversion: 2.1 time: 0.090075 May 27 10:09:23.421432 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 606/1202] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:09:23 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 27 10:09:24.438669 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-33f14ba9-2b4a-4786-84c8-f196ecdb46d5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:24.439366 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-33f14ba9-2b4a-4786-84c8-f196ecdb46d5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: dc1172d8-1a8d-4a84-acac-3643ec277305] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:24.445817 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-33f14ba9-2b4a-4786-84c8-f196ecdb46d5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:24.446285 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-33f14ba9-2b4a-4786-84c8-f196ecdb46d5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:24.447061 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-33f14ba9-2b4a-4786-84c8-f196ecdb46d5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:24.447497 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-33f14ba9-2b4a-4786-84c8-f196ecdb46d5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:24.461436 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-33f14ba9-2b4a-4786-84c8-f196ecdb46d5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] HTTP exception thrown: Instance dc1172d8-1a8d-4a84-acac-3643ec277305 could not be found. May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-33f14ba9-2b4a-4786-84c8-f196ecdb46d5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Request method failure captured: May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 HTTP/1.1 May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikKF1fFhRZe7yxXme7VVQkO_-55UXOBGijikvi4V_os1FR_QpSugoOdaBa3EsXQTDbfvvzWNOU1n4GIZCZlxWOnOt8ikJnie45FB5frkizKACCLFhZx3kmO4ozAGY8BHVml_L__KwyMImIUrUlI6AKS1wAVysiLbbDDRiWNvTI4iCyrM May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: fb894beeec434e34b0a8224128eda0c1 May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 10:09:24.463670 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fb894beeec434e34b0a8224128eda0c1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: fb894beeec434e34b0a8224128eda0c1 May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-TestVolumeBootPattern-1126995217-project May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: ce5ba392d54f4d9588b7e3f891e8e331 May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-TestVolumeBootPattern-1126995217-project May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance dc1172d8-1a8d-4a84-acac-3643ec277305 could not be found. May 27 10:09:24.470322 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': 'dc1172d8-1a8d-4a84-acac-3643ec277305'} May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc1172d8-1a8d-4a84-acac-3643ec277305 could not be found. May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 10:09:24.471799 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc1172d8-1a8d-4a84-acac-3643ec277305 could not be found. May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc1172d8-1a8d-4a84-acac-3643ec277305 could not be found. May 27 10:09:24.473423 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:24.475026 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-33f14ba9-2b4a-4786-84c8-f196ecdb46d5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Returning 404 to user: Instance dc1172d8-1a8d-4a84-acac-3643ec277305 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 10:09:24.475026 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-33f14ba9-2b4a-4786-84c8-f196ecdb46d5 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305" status: 404 len: 111 microversion: 2.1 time: 0.031299 May 27 10:09:24.475026 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 597/1203] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:09:24 2022] GET /compute/v2.1/servers/dc1172d8-1a8d-4a84-acac-3643ec277305 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 10:09:24.988793 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-23aeeff7-2271-45c3-bfdd-70e038552caf tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:24.989340 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.compute.api [None req-23aeeff7-2271-45c3-bfdd-70e038552caf tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124829) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:24.996191 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23aeeff7-2271-45c3-bfdd-70e038552caf tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:24.997225 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23aeeff7-2271-45c3-bfdd-70e038552caf tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:24.997484 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23aeeff7-2271-45c3-bfdd-70e038552caf tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:24.997914 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG oslo_concurrency.lockutils [None req-23aeeff7-2271-45c3-bfdd-70e038552caf tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:25.011567 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.wsgi [None req-23aeeff7-2271-45c3-bfdd-70e038552caf tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] HTTP exception thrown: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-23aeeff7-2271-45c3-bfdd-70e038552caf tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Request method failure captured: May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: request: DELETE /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 HTTP/1.1 May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept: application/json May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Accept-Encoding: identity May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Connection: close May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Length: 0 May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Content-Type: application/json May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Host: 10.222.0.48 May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Openstack-System-Scope: None May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: User-Agent: python-urllib3/1.26.9 May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Auth-Token: gAAAAABikKF1fFhRZe7yxXme7VVQkO_-55UXOBGijikvi4V_os1FR_QpSugoOdaBa3EsXQTDbfvvzWNOU1n4GIZCZlxWOnOt8ikJnie45FB5frkizKACCLFhZx3kmO4ozAGY8BHVml_L__KwyMImIUrUlI6AKS1wAVysiLbbDDRiWNvTI4iCyrM May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Id: None May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Domain-Name: None May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Identity-Status: Confirmed May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Is-Admin-Project: True May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Id: default May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Domain-Name: Default May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Id: fb894beeec434e34b0a8224128eda0c1 May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Project-Name: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Role: reader,member May 27 10:09:25.013213 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Roles: reader,member May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fb894beeec434e34b0a8224128eda0c1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Id: fb894beeec434e34b0a8224128eda0c1 May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User: tempest-TestVolumeBootPattern-1126995217-project May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Id: default May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Domain-Name: Default May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Id: ce5ba392d54f4d9588b7e3f891e8e331 May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: X-User-Name: tempest-TestVolumeBootPattern-1126995217-project May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: method: > May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: exception: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:09:25.014901 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: action_args: {'id': '51149850-0b50-45f8-b705-f8b87fe14768'} May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 10:09:25.015747 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:09:25.017199 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: ERROR nova.api.openstack.wsgi May 27 10:09:25.018578 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-23aeeff7-2271-45c3-bfdd-70e038552caf tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Returning 404 to user: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. {{(pid=124829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 10:09:25.018578 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-23aeeff7-2271-45c3-bfdd-70e038552caf tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "DELETE /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 404 len: 111 microversion: 2.1 time: 0.029750 May 27 10:09:25.018578 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 607/1204] 10.222.0.48 () {58 vars in 1238 bytes} [Fri May 27 10:09:24 2022] DELETE /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 10:09:25.023181 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4abcc4b0-01f7-4b86-ac2f-55904531ca83 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '>' {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:25.023789 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.compute.api [None req-4abcc4b0-01f7-4b86-ac2f-55904531ca83 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] [instance: 51149850-0b50-45f8-b705-f8b87fe14768] Fetching instance by UUID {{(pid=124828) get /opt/stack/nova/nova/compute/api.py:2920}} May 27 10:09:25.030307 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4abcc4b0-01f7-4b86-ac2f-55904531ca83 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:25.030769 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4abcc4b0-01f7-4b86-ac2f-55904531ca83 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:25.031492 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4abcc4b0-01f7-4b86-ac2f-55904531ca83 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 27 10:09:25.031921 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG oslo_concurrency.lockutils [None req-4abcc4b0-01f7-4b86-ac2f-55904531ca83 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Lock "5a9d6ff3-00ce-4e8e-a14e-fde7b7af7c35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124828) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 27 10:09:25.046312 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.wsgi [None req-4abcc4b0-01f7-4b86-ac2f-55904531ca83 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] HTTP exception thrown: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4abcc4b0-01f7-4b86-ac2f-55904531ca83 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Request method failure captured: May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: request: GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 HTTP/1.1 May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept: application/json May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Accept-Encoding: identity May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Connection: close May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Length: 0 May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Content-Type: application/json May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Host: 10.222.0.48 May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Openstack-System-Scope: None May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: User-Agent: python-urllib3/1.26.9 May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Auth-Token: gAAAAABikKF1fFhRZe7yxXme7VVQkO_-55UXOBGijikvi4V_os1FR_QpSugoOdaBa3EsXQTDbfvvzWNOU1n4GIZCZlxWOnOt8ikJnie45FB5frkizKACCLFhZx3kmO4ozAGY8BHVml_L__KwyMImIUrUlI6AKS1wAVysiLbbDDRiWNvTI4iCyrM May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Id: None May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Domain-Name: None May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Identity-Status: Confirmed May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Is-Admin-Project: True May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Id: default May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Domain-Name: Default May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Id: fb894beeec434e34b0a8224128eda0c1 May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Project-Name: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Role: reader,member May 27 10:09:25.047848 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Roles: reader,member May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/fb894beeec434e34b0a8224128eda0c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_fb894beeec434e34b0a8224128eda0c1", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}] May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Id: fb894beeec434e34b0a8224128eda0c1 May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-Tenant-Name: tempest-TestVolumeBootPattern-1126995217 May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User: tempest-TestVolumeBootPattern-1126995217-project May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Id: default May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Domain-Name: Default May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Id: ce5ba392d54f4d9588b7e3f891e8e331 May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: X-User-Name: tempest-TestVolumeBootPattern-1126995217-project May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: method: > May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: exception: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:09:25.049540 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: action_args: {'id': '51149850-0b50-45f8-b705-f8b87fe14768'} May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: {{(pid=124828) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 27 10:09:25.050622 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. May 27 10:09:25.052262 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: ERROR nova.api.openstack.wsgi May 27 10:09:25.053879 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: DEBUG nova.api.openstack.wsgi [None req-4abcc4b0-01f7-4b86-ac2f-55904531ca83 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Returning 404 to user: Instance 51149850-0b50-45f8-b705-f8b87fe14768 could not be found. {{(pid=124828) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 27 10:09:25.053879 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO nova.api.openstack.requestlog [None req-4abcc4b0-01f7-4b86-ac2f-55904531ca83 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768" status: 404 len: 111 microversion: 2.1 time: 0.029835 May 27 10:09:25.053879 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: [pid: 124828|app: 0|req: 598/1205] 10.222.0.48 () {58 vars in 1235 bytes} [Fri May 27 10:09:25 2022] GET /compute/v2.1/servers/51149850-0b50-45f8-b705-f8b87fe14768 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 27 10:09:26.525663 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: DEBUG nova.api.openstack.wsgi [None req-5ff3c152-843e-49e3-96ca-49b2672bcc92 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] Calling method '.version_select at 0x7fbe32142a60>' {{(pid=124829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 27 10:09:26.590782 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO nova.api.openstack.requestlog [None req-5ff3c152-843e-49e3-96ca-49b2672bcc92 tempest-TestVolumeBootPattern-1126995217 tempest-TestVolumeBootPattern-1126995217-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-429678364" status: 202 len: 0 microversion: 2.1 time: 0.069493 May 27 10:09:26.591389 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: [pid: 124829|app: 0|req: 608/1206] 10.222.0.48 () {58 vars in 1259 bytes} [Fri May 27 10:09:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-429678364 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 27 10:09:50.154717 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:09:50.155344 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 10:09:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:09:54.963166 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:09:54.964079 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 10:09:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:10:03.673879 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:10:03.674557 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 10:10:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:11:35.108233 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:11:35.108968 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 10:11:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:12:12.007806 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:12:12.008502 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 10:12:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:13:10.163318 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:13:10.164026 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 10:13:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:13:14.971691 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:13:14.972349 dv-cinder-825492-18-iscsi devstack@n-api.service[124828]: Fri May 27 10:13:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:13:23.682039 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:13:23.682686 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 10:13:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 27 10:14:55.116694 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 27 10:14:55.117518 dv-cinder-825492-18-iscsi devstack@n-api.service[124829]: Fri May 27 10:14:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!